-- Logs begin at Thu 2022-05-26 15:42:19 UTC, end at Thu 2022-05-26 17:11:27 UTC. -- May 26 16:43:17.731500 dv-cinder-836070-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 16:43:17.743876 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 16:43:17.747129 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 16:43:17 2022] *** May 26 16:43:17.747129 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 16:43:17.747129 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 16:43:17.747129 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: nodename: dv-cinder-836070-4-iscsi May 26 16:43:17.747129 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: machine: x86_64 May 26 16:43:17.747129 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: clock source: unix May 26 16:43:17.747129 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: pcre jit disabled May 26 16:43:17.747129 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: detected number of CPU cores: 4 May 26 16:43:17.747129 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: current working directory: / May 26 16:43:17.747129 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: detected binary path: /usr/bin/uwsgi-core May 26 16:43:17.747129 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: your processes number limit is 47680 May 26 16:43:17.747129 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: your memory page size is 4096 bytes May 26 16:43:17.749074 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: detected max file descriptor number: 2048 May 26 16:43:17.749074 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: lock engine: pthread robust mutexes May 26 16:43:17.749074 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: thunder lock: enabled May 26 16:43:17.749074 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 16:43:17.749074 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 16:43:17.794409 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: Python main interpreter initialized at 0x565349acf9c0 May 26 16:43:17.794409 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: python threads support enabled May 26 16:43:17.794409 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: your server socket listen backlog is limited to 100 connections May 26 16:43:17.794409 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: your mercy for graceful operations on workers is 90 seconds May 26 16:43:17.794924 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: mapped 403077 bytes (393 KB) for 2 cores May 26 16:43:17.795027 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: *** Operational MODE: preforking *** May 26 16:43:17.795388 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: *** uWSGI is running in multiple interpreter mode *** May 26 16:43:17.795388 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: spawned uWSGI master process (pid: 110353) May 26 16:43:17.795663 dv-cinder-836070-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 16:43:17.797733 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: spawned uWSGI worker 1 (pid: 110354, cores: 1) May 26 16:43:17.797733 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: spawned uWSGI worker 2 (pid: 110355, cores: 1) May 26 16:43:17.797733 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 16:43:19.049976 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 16:43:19.077791 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 16:43:19.818648 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:43:19.818648 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: from cryptography.utils import int_from_bytes May 26 16:43:19.819059 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:43:19.819059 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: from cryptography.utils import int_from_bytes May 26 16:43:19.825296 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:43:19.825296 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: from cryptography.utils import int_from_bytes May 26 16:43:19.825799 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:43:19.825799 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: from cryptography.utils import int_from_bytes May 26 16:43:22.511737 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:43:22.512631 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:43:22.512774 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:43:22.512774 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:43:22.513811 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:43:22.513950 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:43:22.514077 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:43:22.514077 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:43:22.514323 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:43:22.514323 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:43:22.514578 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.514704 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.514845 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.514980 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.515106 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.515106 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.515374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.515374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.515615 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.515615 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.515864 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.515864 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.516088 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.516221 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.516343 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.516477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.516618 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.516618 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.516848 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.516848 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.517087 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.517222 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.517414 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836070-4-iscsi {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.517542 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836070-4-iscsi {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.517681 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.517681 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.517933 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.518118 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.518257 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.518393 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.518514 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.518655 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.518790 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.518930 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.519065 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.519255 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.519461 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.519612 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.519754 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.521317 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.521537 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.521685 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.521826 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.522065 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.522268 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.522410 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.522617 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.522777 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.522922 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.523093 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.523286 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.523441 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.523585 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.523772 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.523948 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.524119 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.524296 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.524439 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.524608 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.524744 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.524928 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836070-4-iscsi {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.525070 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836070-4-iscsi {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.525300 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.526044 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.526254 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.526395 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.526627 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.526771 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.526917 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.527188 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.527362 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.527501 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.527689 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.527839 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.528016 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.528156 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.528331 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.528484 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.528638 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.528777 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.528973 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.529146 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.530763 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.531118 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.531651 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.531981 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.532434 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.532802 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.533028 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.533299 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.533582 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.533824 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.534084 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.534392 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.534653 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.534877 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.535253 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.535475 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.535706 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.535841 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.536021 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.536179 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.536366 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.536503 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.536730 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.536918 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.537164 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.537402 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.537577 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.537766 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.537955 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.538206 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.538418 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.538608 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.538820 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.539028 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.539223 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.539420 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.539700 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.539893 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.540087 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.540332 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.540561 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.541127 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.542177 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.542311 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.542462 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.542589 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.542755 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.543010 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.543171 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.543324 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.543446 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.543651 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.543820 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.543980 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.544131 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.544290 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.544415 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.544574 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.544697 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.544880 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.545032 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.545212 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.545386 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.545535 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.545673 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.545830 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.545955 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.546083 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.546231 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.546353 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.546353 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.546600 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.546722 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.546850 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.546972 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.547091 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.547247 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.547373 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.547494 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.547640 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.547760 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.547906 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.548048 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.548193 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.548316 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.548436 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.548569 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.548722 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.548852 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.548974 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.549093 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.549220 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.549220 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.549622 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.549753 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.549753 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.549977 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.550108 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.550108 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.550345 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.550473 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.550473 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.550707 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.550834 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.551083 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.551218 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.551218 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.551447 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.551568 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.551568 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.551803 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.551932 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.551932 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.552396 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.552525 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.552525 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.552761 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.552889 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.552889 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.553216 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.553369 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.553369 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.553647 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.553784 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.553913 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.554042 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.554042 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.554270 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.554402 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.554402 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.554629 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.554749 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.554749 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.554975 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.555103 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.555226 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.555356 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.555356 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.555601 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.555748 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.555748 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.555989 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.556131 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.556131 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.556395 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.556519 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.556519 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.556926 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.557081 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.557081 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.557342 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.557590 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.557590 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.557877 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.558032 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.558263 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.558464 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.558464 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.558914 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.559158 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.559158 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.559754 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.559893 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.559893 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.560161 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.560309 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.560441 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.560590 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.560590 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.560875 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.561001 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.561001 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.561433 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.561556 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.561556 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.561819 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.561942 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.562065 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.562184 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.562320 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.562649 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.562649 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.562906 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.563037 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.563037 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.563318 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.563452 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.563576 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.563705 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.563705 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.563922 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.564053 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.564053 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.564280 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.564398 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.564551 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.564673 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.564673 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.564960 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.565127 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.565127 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.565415 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.565538 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.565538 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.565802 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.565930 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.566051 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.566171 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.566171 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.566422 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.566544 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.566544 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.566771 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.566891 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.567018 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.567155 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.567155 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.567384 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.567510 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.567510 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.567746 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.567891 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.568021 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.568143 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.568323 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.568650 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.568789 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.568970 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.569254 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:43:22.569443 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.569615 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.569908 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.570044 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.570237 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.570511 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.570636 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.570892 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.571146 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.571316 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.571584 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.571745 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.571908 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.572226 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.573074 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.573217 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.573381 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.573543 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.573682 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.573991 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.574126 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.574301 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.574617 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.574748 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.574930 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.575259 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.575402 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.575590 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.575885 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.576016 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.576245 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.576523 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.576657 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.576838 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.577113 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.577250 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.577482 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.577731 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.577867 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.578093 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.578303 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.578453 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.578702 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.578895 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.579030 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.579332 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.579501 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.579626 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.580009 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.580144 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.580274 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.580555 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.580679 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.580876 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.581192 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.581418 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.581708 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.581844 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.581989 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.582135 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.582376 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.582613 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.582762 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.582973 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.583321 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.583452 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.583602 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.583733 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.584015 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.584142 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.584342 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.584670 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.584821 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.584976 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.585378 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.585509 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.585634 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.585922 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.586046 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.586233 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.586543 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.586678 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.586855 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.587158 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.587298 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.587464 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.587749 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.587902 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.588138 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.589136 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.589324 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.589531 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.589760 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.589899 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.590223 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.590407 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.590579 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.590927 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.591060 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.591284 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.591549 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.591691 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.591921 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.592155 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.592282 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.592568 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.592749 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.592913 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.593419 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.593580 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.593706 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.593858 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.593984 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.594177 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.594379 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.594506 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.594794 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.594923 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.595121 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.595435 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.595567 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.595759 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.596047 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.596175 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.596440 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.596654 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.596790 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.597004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.597232 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.597398 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.597655 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.597843 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.598002 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.598343 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.598476 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.598679 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.598995 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.599187 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.599389 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.599577 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.599892 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.600150 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.600496 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.600661 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.600791 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.601031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.601323 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.601533 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.601712 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.601910 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.602068 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.602325 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.602461 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.602641 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.602982 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.603111 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.603296 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.603732 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.603862 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.604005 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.604254 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.604381 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.604591 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.604882 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.605022 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.605229 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.605487 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.605616 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.605887 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.606081 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.606267 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.606584 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.606723 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.606958 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.607191 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.607355 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.607749 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.607946 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.608211 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.608373 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.608653 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.608885 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.609020 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.609299 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.609505 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.609631 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.609930 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.610104 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.610244 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.610555 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.610733 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.610892 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.611170 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.611335 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.611519 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.611804 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.611967 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.612113 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.612378 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.612541 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.612737 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.612946 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.613096 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.613418 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.613584 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.613967 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.614123 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.614276 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.614426 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.614631 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.614786 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.614946 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.615261 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.615388 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.615567 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.615842 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.615977 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.616200 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.616469 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.616634 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.616891 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.617059 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.617222 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.617538 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.617689 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.617868 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.618187 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.618440 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.618587 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.618799 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.618924 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.619110 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.619453 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.619582 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.619766 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.620090 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.620220 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.620401 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.620691 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.620872 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.621050 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.621291 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.621426 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.621639 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.621870 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.621996 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.622454 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.622617 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.622869 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.623019 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.623216 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.623522 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.623650 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.623987 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.624132 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.624282 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.624483 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.624697 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.624825 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.625148 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.625311 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.625488 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.625803 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.625953 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.626113 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.626419 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.626555 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.626734 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.626989 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.627116 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.627339 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.627563 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.627714 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.627948 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.628161 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.628314 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.628551 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.628718 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.628878 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.629155 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.629351 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.629502 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.629799 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.629984 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.630134 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.630395 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.630552 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.630751 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.631022 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.631159 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.631352 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.631587 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.631738 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.631934 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.632224 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.632366 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.632580 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.632846 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.632996 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.633229 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.633460 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.633588 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.633900 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.634259 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.634400 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.634525 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.634647 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.634820 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.635665 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.635804 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.635982 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.636269 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.636396 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.636580 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.636844 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.636971 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.637191 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.637451 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.637660 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.638009 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.638136 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.638327 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.638612 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.638740 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.638938 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.639190 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.639316 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.639553 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.639773 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.639900 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.640159 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.640352 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.640478 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.640764 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.641057 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.641204 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.641691 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.641802 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.641908 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.642027 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.642141 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.642297 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.642668 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.642794 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.642927 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.643196 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.643324 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.643515 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.643804 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.644023 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.644487 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.644822 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.645138 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.645478 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.645788 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.646101 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.646412 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.646713 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.647026 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.647355 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.647677 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.647986 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.648300 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.648608 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.648918 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.649228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.649567 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.649875 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.650182 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.650516 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.651400 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.652102 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.652749 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.653530 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.653927 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.654144 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.654710 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.655225 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.655389 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.655592 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.655882 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.656048 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.656255 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.656482 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.656639 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.656910 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.657070 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.657302 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.657622 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.657780 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.658001 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.658174 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.658322 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.658641 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.658803 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.658952 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.659211 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.659381 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.659593 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.659741 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.659902 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.660222 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.660405 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.660555 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.660823 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.660978 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.661167 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.661437 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.661605 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.661831 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.662049 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.662203 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.662472 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.662648 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.662912 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.663106 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.663258 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.663442 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.663778 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.663945 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.664226 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.664406 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.664658 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.664946 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.665108 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.665402 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.665559 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.665704 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.666037 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.666193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.666414 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.666667 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.666835 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.667053 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.667213 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.667370 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.667683 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.667854 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.668003 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.668303 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.668458 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.668615 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.669005 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.669169 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.669381 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.669549 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.669691 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.669880 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.670052 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.670199 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.670500 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.670659 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.670816 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.671115 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.671352 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.671791 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.671939 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.672120 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.672287 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.672542 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.672771 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.672929 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.673130 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.673415 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.673577 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.673944 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.674221 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.674373 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.674566 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.674887 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.675142 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.675305 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.675467 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.675716 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.675877 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.676078 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.676275 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.676442 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.676748 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.677006 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.677304 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.677513 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.677662 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.677925 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.678082 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.678242 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.678551 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.678710 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.678950 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.679119 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.679267 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.679580 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.679736 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.680015 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.680186 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.680346 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.680633 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.680789 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.681061 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.681370 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.681553 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.681697 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.681977 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.682149 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.682397 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.682570 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.682729 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.683031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.683193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.683338 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.683662 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.683814 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.683975 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.684249 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.684649 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.684649 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.684909 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.685125 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.685322 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.685467 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.685635 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.685877 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.686027 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.686185 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.686515 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.686668 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.686949 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.687107 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.687265 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.687585 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.687738 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.687911 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.688195 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.688354 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.688536 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.688786 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.688949 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.689347 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.689507 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.689655 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.689925 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.690090 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.690247 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.690494 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.690646 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.690858 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.691054 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.691223 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.691461 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.691606 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.691749 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.692068 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.692234 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.692375 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.692692 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.693021 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.693177 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.693345 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.693688 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.693844 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.693990 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.694311 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.694475 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.694620 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.694942 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.695098 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.695308 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.695543 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.695709 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.695870 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.696140 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.696413 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.696576 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.696752 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.696906 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.697113 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.698129 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.698383 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.698541 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.699090 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.699275 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.699668 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.700251 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.700834 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.703030 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.703030 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.703030 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.703458 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.703658 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.703817 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.704022 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.704380 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.704743 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.705075 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.705428 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.705765 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.705947 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.706098 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.706398 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.706570 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.706731 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.707036 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.707352 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.707666 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.707805 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.707980 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.708296 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.708441 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.708622 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.708887 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.709030 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.709324 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.709608 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.709923 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.710234 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.710594 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.710909 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.711257 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.711585 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.711744 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.711909 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.712240 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.712412 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.712561 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.712829 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.712996 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.714026 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.714342 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.714665 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.714990 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.715316 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.715757 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.716046 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.716310 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.716484 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.716682 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.716922 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.717080 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.717350 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.717501 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.718048 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.719144 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.719299 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.719449 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.719599 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.719599 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.719898 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.720045 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.720045 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.720314 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.720462 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.720622 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.720801 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.720801 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.721083 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.721229 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.721229 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.721574 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.721719 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.721873 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.722017 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.722282 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.722493 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.722657 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.722803 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.722941 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.723093 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.723335 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.723510 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.723698 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.723888 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.724069 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.724398 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.724623 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.724785 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.725001 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.725141 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.725357 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.725608 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.725798 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.725987 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.726175 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.726328 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.726616 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.726770 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.726931 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.727238 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.727392 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.727531 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.727839 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.727962 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.728162 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.728421 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.728581 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.729465 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.729630 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.729782 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.730021 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.730174 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.730333 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.730652 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.730770 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.731209 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.731304 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.731538 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.731784 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.731881 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.732211 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.732348 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.732538 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.732870 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.733022 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.733194 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.733562 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.733718 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.733862 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.734131 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.734265 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.734478 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.734844 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.735049 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.735205 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.735365 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.735486 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.735711 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.735867 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.736015 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.736333 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.736492 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.736642 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.736912 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.737178 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.737501 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.737676 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.737871 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.738039 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.738193 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.738518 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.738679 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.738849 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.739135 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.739290 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.739438 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.739695 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.739811 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.740050 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.740255 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.740412 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.740671 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.740832 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.740997 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.741294 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.741448 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.741591 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.741907 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.742068 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.742245 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.742515 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.742672 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.742818 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.743087 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.743250 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.743428 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.743649 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.743806 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.744020 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.744176 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.744866 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.745184 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.745371 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.745521 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.745830 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.745987 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.746160 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.746441 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.746595 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.746741 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.747032 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.747108 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.747342 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.747582 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.747746 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.747954 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.748136 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.748288 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.748620 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.748778 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.749090 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.749245 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.749445 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.749597 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.749831 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.749992 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.750178 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.750393 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.750549 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.750812 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.750967 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.751128 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.751468 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.751628 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.751779 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.752032 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.752330 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.752586 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.752680 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.752975 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.753186 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.753407 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.753674 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.753823 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.753968 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.754283 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.754435 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.754597 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.754872 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.755024 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.755219 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.755429 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.755598 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.755840 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.756055 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.756203 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.756459 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.756616 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.756783 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.757079 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.757233 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.757427 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.757721 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.757876 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.758145 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.758311 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.758453 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.758633 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.758932 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.759098 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.759245 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.759510 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.759666 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.759927 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.760112 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.760278 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.760557 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.760713 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.760855 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.761175 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.761382 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.761544 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.761884 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.762050 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.762200 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.762391 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.762544 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.762752 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.762975 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.763132 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.763365 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.763522 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.763797 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.764078 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.764235 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.764431 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.764664 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.764824 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.765059 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.765383 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.765537 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.765734 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.765902 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.766044 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.766370 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.766525 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.766672 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.767006 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.767155 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.767349 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.767683 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.767842 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.767989 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.768255 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.768424 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.768589 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.768835 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.768993 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.769186 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.769414 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.769537 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.769856 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.770013 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.770164 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.770455 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.770625 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.770784 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.770993 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.771093 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.771356 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.771521 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.771669 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.771957 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.772114 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.772276 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.772553 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.772712 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.772863 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.773065 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.773231 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.773454 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.773660 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.773827 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.774069 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.774240 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.774389 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.774674 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.774826 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.774972 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.775270 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.775394 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.775586 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.775869 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.776083 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.776234 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.776453 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.776610 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.776843 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.777037 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.777192 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.777504 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.777678 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.777826 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.778232 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.778402 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.778553 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.778711 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.778872 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.779080 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.779277 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.779432 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.779721 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.779877 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.780039 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.780337 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.780636 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.780950 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.780950 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.781252 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.781401 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.781574 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.781805 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.781979 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.782232 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.782399 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.782550 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.782861 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.783015 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.783176 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.783483 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.783669 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.783820 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.784058 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.784214 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.784422 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.784597 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.784745 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.785034 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.785220 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.785405 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.785680 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.785853 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.785999 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.786295 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.786440 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.786609 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.786929 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.787102 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.787261 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.787527 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.787680 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.787864 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.788095 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.788270 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.788539 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.788698 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.788847 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.789192 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.789463 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.789603 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.789854 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.790015 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.790161 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.790437 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.790616 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.790718 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:43:22.791004 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.792114 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.792715 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.793299 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.793898 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.794679 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.795264 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.795831 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.796602 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.797178 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.797791 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.798392 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.798995 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.799571 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.800121 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.800711 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.801321 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.801923 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.802526 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.803121 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.803704 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.804272 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.804846 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.805451 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.806043 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.806642 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.807977 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.808568 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.809158 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.809806 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.810348 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.810891 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.811458 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.812037 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.812606 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.813171 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.813792 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.814353 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.814931 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.815512 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.816095 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.816670 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.817244 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.817860 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.818433 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.819031 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.819623 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.820231 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.820830 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.821422 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.822020 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.822781 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.823352 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.823925 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.824491 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.825134 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.825734 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.826328 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.826945 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.827555 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.828128 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.828751 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.829381 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.829969 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.830558 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.831151 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.831719 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.832290 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.832856 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.833456 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.834022 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.834542 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.835113 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.835672 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.836235 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.836811 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.837422 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.838027 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.838627 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.839469 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.840027 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.840605 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.841176 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.841844 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.842416 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.843032 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.843617 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.844217 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.844829 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.845439 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.846039 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.846626 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.847218 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.847802 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.848390 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.848964 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.849589 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.850192 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.850772 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.851221 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO dbcounter [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] Registered counter for database nova_api May 26 16:43:22.851353 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.851927 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.852513 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.853533 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.854645 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.855223 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.855797 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.856370 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.856938 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.857543 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.858124 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.858698 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.859282 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.859873 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.860486 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.861076 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.861715 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.862334 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.862923 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.863512 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.864097 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.864675 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.865371 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.865955 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.866524 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.867172 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.867697 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.868286 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.868866 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.870030 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.870615 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.871202 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.871784 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.872372 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.872960 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.873575 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.874188 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.874761 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_db.sqlalchemy.engines [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:43:22.874903 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.875350 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.875928 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.876507 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.877102 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.878164 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.878758 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.879367 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.879955 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.880561 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.881156 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.881779 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.882371 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG dbcounter [-] [110354] Writer thread running {{(pid=110354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:43:22.882521 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.882934 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.883499 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.884076 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.884661 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.885779 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.886380 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.886954 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.887522 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.888112 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.888698 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.889792 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.890427 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.891018 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.891620 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.892214 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.892805 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.893446 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.894038 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.894603 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.895167 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.895750 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.896338 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.896833 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.897441 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.898028 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.898599 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.899161 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.899742 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.900320 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.901531 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.902100 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.902668 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.903230 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.903819 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.904383 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.904927 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.905510 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.906067 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.906648 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.907221 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.907801 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.908361 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.908924 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.909529 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.910103 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.910736 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.911343 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.911910 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.912481 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.913074 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.913689 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.914274 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.914846 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.915425 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.916057 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.917479 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.919221 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.919221 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.919547 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.920017 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.920614 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.921192 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.921789 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.922356 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.922961 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.923517 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.924196 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.924675 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.925253 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.925854 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.926424 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.927008 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.927592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.928184 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.928780 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.929407 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.930002 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.930592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.931165 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.931832 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.932923 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.933529 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.934111 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.934732 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.935263 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.935839 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.936406 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.936984 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.937595 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.938221 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.938797 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.939376 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.940173 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.940750 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.941386 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.941990 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.942538 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.943135 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.943752 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.944321 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.944912 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.945535 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.945989 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.context [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c318fc1c-f63e-4318-9beb-7eb6730543cf(cell1) {{(pid=110354) load_cells /opt/stack/nova/nova/context.py:464}} May 26 16:43:22.946136 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.946755 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.947384 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.947976 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.948555 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.949111 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.949698 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.950295 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.950439 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:22.950900 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.951459 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.952019 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:22.952218 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.952576 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.952873 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:22.953155 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.953762 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.954327 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.954911 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.955063 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:22.955475 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.956044 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.956594 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.957172 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.957556 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO dbcounter [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] Registered counter for database nova_cell0 May 26 16:43:22.957769 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.958343 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.958903 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.959425 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.959923 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.960407 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.960940 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.961502 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.962072 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.962216 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO dbcounter [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] Registered counter for database nova_cell1 May 26 16:43:22.962631 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.964034 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.964653 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.965250 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.965865 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.966459 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.967047 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.967621 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.968207 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.968816 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.969446 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.970026 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.970645 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.971197 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.971723 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.971883 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_db.sqlalchemy.engines [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:43:22.972240 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.972741 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.973253 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.973790 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.974320 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.974410 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_db.sqlalchemy.engines [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:43:22.974849 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.975346 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.975873 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.976391 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.976908 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.977431 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.977919 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.978449 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.979495 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.979677 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG dbcounter [-] [110354] Writer thread running {{(pid=110354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:43:22.979989 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.980484 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.980977 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.981504 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.982003 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.982507 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.983028 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.983537 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.984033 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.984538 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.985050 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.985634 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.986138 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.986679 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.987176 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.987672 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.988162 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.988636 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:43:22.989024 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:43:23.100954 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO dbcounter [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] Registered counter for database nova_api May 26 16:43:23.131478 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG dbcounter [-] [110354] Writer thread running {{(pid=110354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:43:23.135506 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG oslo_db.sqlalchemy.engines [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:43:23.143070 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO dbcounter [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] Registered counter for database nova_cell0 May 26 16:43:23.145602 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG dbcounter [-] [110355] Writer thread running {{(pid=110355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:43:23.152772 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_db.sqlalchemy.engines [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:43:23.158640 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG dbcounter [-] [110354] Writer thread running {{(pid=110354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:43:23.207125 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.context [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c318fc1c-f63e-4318-9beb-7eb6730543cf(cell1) {{(pid=110355) load_cells /opt/stack/nova/nova/context.py:464}} May 26 16:43:23.211458 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG oslo_concurrency.lockutils [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:23.213569 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG oslo_concurrency.lockutils [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:23.214636 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG oslo_concurrency.lockutils [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:43:23.216645 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG oslo_concurrency.lockutils [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:43:23.218961 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO dbcounter [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] Registered counter for database nova_cell0 May 26 16:43:23.223253 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO dbcounter [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] Registered counter for database nova_cell1 May 26 16:43:23.231885 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG oslo_db.sqlalchemy.engines [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:43:23.233691 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG oslo_db.sqlalchemy.engines [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:43:23.239822 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG dbcounter [-] [110355] Writer thread running {{(pid=110355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:43:23.241484 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG dbcounter [-] [110355] Writer thread running {{(pid=110355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:43:23.394274 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO dbcounter [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] Registered counter for database nova_cell0 May 26 16:43:23.403759 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG oslo_db.sqlalchemy.engines [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:43:23.408682 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG dbcounter [-] [110355] Writer thread running {{(pid=110355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:43:23.770902 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: WARNING keystonemiddleware.auth_token [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:43:23.779084 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: WARNING keystonemiddleware.auth_token [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:43:23.981050 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: WARNING keystonemiddleware.auth_token [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:43:23.988568 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: WARNING keystonemiddleware.auth_token [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:43:24.158488 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: WARNING keystonemiddleware.auth_token [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:43:24.164839 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: WARNING keystonemiddleware.auth_token [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:43:24.170503 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x565349acf9c0 pid: 110354 (default app) May 26 16:43:24.172900 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:43:24.174224 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002060 May 26 16:43:24.174647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Thu May 26 16:43:24 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:43:24.335359 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: WARNING keystonemiddleware.auth_token [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:43:24.341781 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: WARNING keystonemiddleware.auth_token [None req-1b0e7841-8dc6-4cb6-b601-8090a077e04d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:43:24.347836 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x565349acf9c0 pid: 110355 (default app) May 26 16:44:54.000556 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:54.001649 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 May 26 16:44:54.002255 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 26 16:44:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:44:54.015566 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG dbcounter [-] [110355] Writing DB stats nova_api:SELECT=3 {{(pid=110355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:54.016525 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG dbcounter [-] [110355] Writing DB stats nova_cell0:SELECT=3 {{(pid=110355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:54.017754 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG dbcounter [-] [110355] Writing DB stats nova_cell1:SELECT=3 {{(pid=110355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:54.018608 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG dbcounter [-] [110355] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:54.480362 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-1beed3cf-bdbd-4f32-bd2d-85901fe1c0a7 admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:54.513354 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-1beed3cf-bdbd-4f32-bd2d-85901fe1c0a7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.503123 May 26 16:44:54.514603 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Thu May 26 16:44:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:44:56.832702 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:56.833864 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-35aa6077-e4dd-433e-9233-b3c151fed424 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 26 16:44:56.834521 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 26 16:44:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:44:56.901117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-58502623-c196-4fc5-8761-4693a24f1f5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "swap": 0}} {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:44:56.921638 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:44:56.921638 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: warnings.warn(msg) May 26 16:44:57.071776 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-58502623-c196-4fc5-8761-4693a24f1f5f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.230633 May 26 16:44:57.080122 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 26 16:44:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:44:57.086104 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG dbcounter [-] [110354] Writing DB stats nova_api:SELECT=3 {{(pid=110354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:57.087030 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG dbcounter [-] [110354] Writing DB stats nova_cell0:SELECT=3 {{(pid=110354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:57.088592 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG dbcounter [-] [110354] Writing DB stats nova_cell1:SELECT=3 {{(pid=110354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:57.089536 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG dbcounter [-] [110354] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:57.300749 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-546d64ef-9312-4766-9ae9-b861608fbed3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:44:57.303252 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:44:57.303252 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: warnings.warn(msg) May 26 16:44:57.554241 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-546d64ef-9312-4766-9ae9-b861608fbed3 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.473347 May 26 16:44:57.555190 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Thu May 26 16:44:57 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:44:59.915553 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-58502623-c196-4fc5-8761-4693a24f1f5f admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:44:59.916573 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-58502623-c196-4fc5-8761-4693a24f1f5f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 26 16:44:59.917010 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 26 16:44:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:00.026579 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-cea729c1-4aeb-4934-af53-854b7e150ef1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "id": "d1"}} {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:00.046300 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:45:00.046300 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: warnings.warn(msg) May 26 16:45:00.219067 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-cea729c1-4aeb-4934-af53-854b7e150ef1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.295770 May 26 16:45:00.219902 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 26 16:44:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:45:00.232716 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-17b778e5-0244-4834-962b-9329a4c9eb6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:00.234282 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:45:00.234282 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: warnings.warn(msg) May 26 16:45:00.399626 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-17b778e5-0244-4834-962b-9329a4c9eb6e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.171652 May 26 16:45:00.400239 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Thu May 26 16:45:00 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:02.692289 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-cea729c1-4aeb-4934-af53-854b7e150ef1 admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:02.693431 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-cea729c1-4aeb-4934-af53-854b7e150ef1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 May 26 16:45:02.694090 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 26 16:45:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:45:02.762346 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-aaea083e-5582-489c-8393-0399e1b8b5fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "vcpus": 1, "rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:02.898094 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-aaea083e-5582-489c-8393-0399e1b8b5fa admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.197801 May 26 16:45:02.898787 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 26 16:45:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:45:02.910724 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-c9b837c6-8963-4f37-8914-93cb11b42b75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:03.130859 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-c9b837c6-8963-4f37-8914-93cb11b42b75 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.223194 May 26 16:45:03.131778 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Thu May 26 16:45:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:05.431863 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-aaea083e-5582-489c-8393-0399e1b8b5fa admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:05.432876 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-aaea083e-5582-489c-8393-0399e1b8b5fa admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 26 16:45:05.433463 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 26 16:45:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:05.501635 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-479d03b1-8681-458e-994c-3be91f7c64f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "ram": 2048, "id": "d3", "swap": 0, "rxtx_factor": 1.0}} {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:05.589623 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-479d03b1-8681-458e-994c-3be91f7c64f8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150035 May 26 16:45:05.590313 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 26 16:45:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:45:05.603550 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-9a1b2d2a-5c8d-4163-ac64-37624d343841 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:05.712729 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-9a1b2d2a-5c8d-4163-ac64-37624d343841 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113988 May 26 16:45:05.713595 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Thu May 26 16:45:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:45:07.990527 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-479d03b1-8681-458e-994c-3be91f7c64f8 admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:07.991572 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-479d03b1-8681-458e-994c-3be91f7c64f8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 May 26 16:45:07.992003 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 26 16:45:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:08.060348 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-a90f75bc-02b5-477a-8560-d0d6e9e78efa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "vcpus": 4}} {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:08.301253 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-a90f75bc-02b5-477a-8560-d0d6e9e78efa admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.302679 May 26 16:45:08.302056 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 26 16:45:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 16:45:08.314466 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-6addd249-b1d7-47b3-b658-05b7409334e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:08.467589 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-6addd249-b1d7-47b3-b658-05b7409334e1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.156852 May 26 16:45:08.468199 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Thu May 26 16:45:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:10.745542 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-a90f75bc-02b5-477a-8560-d0d6e9e78efa admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:10.746480 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-a90f75bc-02b5-477a-8560-d0d6e9e78efa admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 26 16:45:10.746882 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 26 16:45:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:10.810647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-8761d910-4f2c-4eb7-8c94-d0a8aef592b4 admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:10.836510 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-8761d910-4f2c-4eb7-8c94-d0a8aef592b4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083283 May 26 16:45:10.837155 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Thu May 26 16:45:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:13.227522 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-a90f75bc-02b5-477a-8560-d0d6e9e78efa admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:13.228748 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-a90f75bc-02b5-477a-8560-d0d6e9e78efa admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 26 16:45:13.229192 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 26 16:45:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:13.293235 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-0fa7b4db-ee53-45a1-92cc-18e0b2aca676 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:13.419819 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-0fa7b4db-ee53-45a1-92cc-18e0b2aca676 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.184364 May 26 16:45:13.420334 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 26 16:45:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:45:13.432989 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-121e145c-cd72-42c0-9b2c-3e403c18c1bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:13.523485 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-121e145c-cd72-42c0-9b2c-3e403c18c1bb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094358 May 26 16:45:13.524121 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Thu May 26 16:45:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:16.047412 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-0fa7b4db-ee53-45a1-92cc-18e0b2aca676 admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:16.048467 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-0fa7b4db-ee53-45a1-92cc-18e0b2aca676 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 May 26 16:45:16.048874 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 26 16:45:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:16.115470 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-ddc7befa-fb4d-4f3a-8c1b-63cba39afdff admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "swap": 0, "disk": 20, "vcpus": 1, "name": "m1.small", "ram": 2048, "rxtx_factor": 1.0}} {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:16.224518 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-ddc7befa-fb4d-4f3a-8c1b-63cba39afdff admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.168152 May 26 16:45:16.225403 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 26 16:45:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 16:45:16.241974 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-d287f394-b0e1-48eb-9be4-d951fe722d93 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:16.362879 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-d287f394-b0e1-48eb-9be4-d951fe722d93 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126238 May 26 16:45:16.363478 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Thu May 26 16:45:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:18.714909 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-ddc7befa-fb4d-4f3a-8c1b-63cba39afdff admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:18.716134 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-ddc7befa-fb4d-4f3a-8c1b-63cba39afdff admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 May 26 16:45:18.716643 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 26 16:45:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:18.782155 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-09c7e8d4-c398-439f-a333-ea80ad9e2bec admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "disk": 40, "id": "3"}} {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:18.870058 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-09c7e8d4-c398-439f-a333-ea80ad9e2bec admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.146644 May 26 16:45:18.870570 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 26 16:45:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 16:45:18.884074 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-a340b448-dbf1-427c-b7de-3a59705bfaae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:19.015541 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-a340b448-dbf1-427c-b7de-3a59705bfaae admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136109 May 26 16:45:19.016141 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Thu May 26 16:45:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:21.346741 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-09c7e8d4-c398-439f-a333-ea80ad9e2bec admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:21.347780 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-09c7e8d4-c398-439f-a333-ea80ad9e2bec admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 26 16:45:21.348786 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 26 16:45:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:21.411935 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-bbf9ab4a-f902-4702-880c-4e983070c0d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:21.540278 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-bbf9ab4a-f902-4702-880c-4e983070c0d0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.184741 May 26 16:45:21.541184 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 26 16:45:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 16:45:21.555350 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-c1838b16-2c49-419a-bcaa-b389e4d4a29b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:21.654448 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-c1838b16-2c49-419a-bcaa-b389e4d4a29b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102779 May 26 16:45:21.668213 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Thu May 26 16:45:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:23.978474 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-bbf9ab4a-f902-4702-880c-4e983070c0d0 admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:23.980497 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-bbf9ab4a-f902-4702-880c-4e983070c0d0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002458 May 26 16:45:23.981128 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 26 16:45:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:24.050164 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-f7ff9880-f3ad-4f50-a577-c60fbdd34671 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "vcpus": 8, "ram": 16384}} {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:24.145475 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-f7ff9880-f3ad-4f50-a577-c60fbdd34671 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.157497 May 26 16:45:24.146154 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Thu May 26 16:45:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:45:24.160307 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-dfbfe02d-dfda-4a22-acfd-d90dab37400b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:24.296043 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG dbcounter [-] [110355] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=110355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:24.302355 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-dfbfe02d-dfda-4a22-acfd-d90dab37400b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.146423 May 26 16:45:24.302888 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Thu May 26 16:45:24 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:45:49.843204 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-f7ff9880-f3ad-4f50-a577-c60fbdd34671 admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:49.844249 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-f7ff9880-f3ad-4f50-a577-c60fbdd34671 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 26 16:45:49.844656 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 26 16:45:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:49.903840 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-a79fe583-5e03-41a9-8208-f3c24d631581 admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:49.921500 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-a79fe583-5e03-41a9-8208-f3c24d631581 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070739 May 26 16:45:49.922035 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Thu May 26 16:45:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:50.954534 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-f7ff9880-f3ad-4f50-a577-c60fbdd34671 admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:50.955558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-f7ff9880-f3ad-4f50-a577-c60fbdd34671 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 26 16:45:50.955975 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 26 16:45:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:51.215999 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-0915f256-7efb-4e1e-8b5b-1146b876b5b9 admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:51.221746 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.wsgi [None req-0915f256-7efb-4e1e-8b5b-1146b876b5b9 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-0915f256-7efb-4e1e-8b5b-1146b876b5b9 admin admin] Request method failure captured: May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Accept: application/json May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Accept-Encoding: gzip, deflate May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Connection: keep-alive May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Content-Length: 0 May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Host: 10.222.0.48 May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Openstack-Api-Version: compute 2.90 May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Openstack-System-Scope: None May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: User-Agent: python-novaclient May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Auth-Token: gAAAAABij66-EF6R9PqWljLiFVHEhifT_B1z4H-TngIIzkbSGC94el-xEwOAeQNBe2a08od6QGIXs9VfObj54zFb1Hi95zl9gl-l1fABYVSVYD2JRkxeCdYC2cO4aoomc2mJXlF7a_-xT4_ydAakj1BnpJxT6DTjmGyqyGlHVZe4ZQLGUVMMRx8 May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Domain-Id: None May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Domain-Name: None May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Identity-Status: Confirmed May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Is-Admin-Project: True May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Project-Domain-Id: default May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Project-Domain-Name: Default May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Project-Id: 76a4e041bd164458a5b1a262dc443e9c May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Project-Name: admin May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Role: member,reader,admin May 26 16:45:51.224985 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Roles: member,reader,admin May 26 16:45:51.226726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76a4e041bd164458a5b1a262dc443e9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76a4e041bd164458a5b1a262dc443e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76a4e041bd164458a5b1a262dc443e9c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76a4e041bd164458a5b1a262dc443e9c"}]}] May 26 16:45:51.226726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Tenant: admin May 26 16:45:51.226726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Tenant-Id: 76a4e041bd164458a5b1a262dc443e9c May 26 16:45:51.226726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Tenant-Name: admin May 26 16:45:51.226726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-User: admin May 26 16:45:51.226726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-User-Domain-Id: default May 26 16:45:51.226726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-User-Domain-Name: Default May 26 16:45:51.226726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-User-Id: ea68495bc01f41d2b0c2e34799485fee May 26 16:45:51.226726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-User-Name: admin May 26 16:45:51.226726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: method: > May 26 16:45:51.226726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: exception: Flavor 42 could not be found. May 26 16:45:51.226726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: action_args: {'id': '42'} May 26 16:45:51.226726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:45:51.226726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:45:51.227726 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi May 26 16:45:51.229477 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-0915f256-7efb-4e1e-8b5b-1146b876b5b9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:45:51.230877 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-0915f256-7efb-4e1e-8b5b-1146b876b5b9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066468 May 26 16:45:51.230877 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Thu May 26 16:45:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 16:45:51.236434 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-6780a780-24c2-4233-b5dc-e385de323f3e admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:51.240015 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG dbcounter [-] [110354] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:51.259775 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-6780a780-24c2-4233-b5dc-e385de323f3e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027027 May 26 16:45:51.260344 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Thu May 26 16:45:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:51.293518 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-49c2bcc4-4179-4650-90ea-ffbc2d8005bf admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:51.316187 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-49c2bcc4-4179-4650-90ea-ffbc2d8005bf admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025623 May 26 16:45:51.316752 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Thu May 26 16:45:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:51.326809 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-3755c666-55eb-468c-b2f7-66ccc4f05fed admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:51.333192 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.wsgi [None req-3755c666-55eb-468c-b2f7-66ccc4f05fed admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-3755c666-55eb-468c-b2f7-66ccc4f05fed admin admin] Request method failure captured: May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Accept: application/json May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Accept-Encoding: gzip, deflate May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Connection: keep-alive May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Content-Length: 0 May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Host: 10.222.0.48 May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Openstack-Api-Version: compute 2.90 May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Openstack-System-Scope: None May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: User-Agent: python-novaclient May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Auth-Token: gAAAAABij66-EF6R9PqWljLiFVHEhifT_B1z4H-TngIIzkbSGC94el-xEwOAeQNBe2a08od6QGIXs9VfObj54zFb1Hi95zl9gl-l1fABYVSVYD2JRkxeCdYC2cO4aoomc2mJXlF7a_-xT4_ydAakj1BnpJxT6DTjmGyqyGlHVZe4ZQLGUVMMRx8 May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Domain-Id: None May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Domain-Name: None May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Identity-Status: Confirmed May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Is-Admin-Project: True May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Project-Domain-Id: default May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Project-Domain-Name: Default May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Project-Id: 76a4e041bd164458a5b1a262dc443e9c May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Project-Name: admin May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Role: member,reader,admin May 26 16:45:51.336795 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Roles: member,reader,admin May 26 16:45:51.338605 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76a4e041bd164458a5b1a262dc443e9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76a4e041bd164458a5b1a262dc443e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76a4e041bd164458a5b1a262dc443e9c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76a4e041bd164458a5b1a262dc443e9c"}]}] May 26 16:45:51.338605 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Tenant: admin May 26 16:45:51.338605 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Tenant-Id: 76a4e041bd164458a5b1a262dc443e9c May 26 16:45:51.338605 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Tenant-Name: admin May 26 16:45:51.338605 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-User: admin May 26 16:45:51.338605 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-User-Domain-Id: default May 26 16:45:51.338605 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-User-Domain-Name: Default May 26 16:45:51.338605 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-User-Id: ea68495bc01f41d2b0c2e34799485fee May 26 16:45:51.338605 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-User-Name: admin May 26 16:45:51.338605 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: method: > May 26 16:45:51.338605 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: exception: Flavor 42 could not be found. May 26 16:45:51.338605 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: action_args: {'id': '42'} May 26 16:45:51.338605 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:45:51.338605 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:45:51.339647 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi May 26 16:45:51.341004 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-3755c666-55eb-468c-b2f7-66ccc4f05fed admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:45:51.342245 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-3755c666-55eb-468c-b2f7-66ccc4f05fed admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015612 May 26 16:45:51.342245 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Thu May 26 16:45:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 16:45:52.251105 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-49c2bcc4-4179-4650-90ea-ffbc2d8005bf admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:52.252114 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-49c2bcc4-4179-4650-90ea-ffbc2d8005bf admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001563 May 26 16:45:52.252508 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 26 16:45:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:52.452119 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-b7e23d6c-1ae2-4574-9236-9fb15d68873b admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:52.459976 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.wsgi [None req-b7e23d6c-1ae2-4574-9236-9fb15d68873b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-b7e23d6c-1ae2-4574-9236-9fb15d68873b admin admin] Request method failure captured: May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Accept: application/json May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Accept-Encoding: gzip, deflate May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Connection: keep-alive May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Content-Length: 0 May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Host: 10.222.0.48 May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Openstack-Api-Version: compute 2.90 May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Openstack-System-Scope: None May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: User-Agent: python-novaclient May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Auth-Token: gAAAAABij67A1nbNEns9BnzibnMrjwX_-tc9shMoaJXmhx6njIKhsfpE07K7Fps1aeeAZjhb_mhyQnQ2Avsv1QeECXTHq4PxcbZDN2HUxm9UDwm9vDZo8Ant9dT90Asq7lWOBlzMifVoROgJ418-YTITuFovbWzZlXE8Cbz54zxISVtxTuafWao May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Domain-Id: None May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Domain-Name: None May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Identity-Status: Confirmed May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Is-Admin-Project: True May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Project-Domain-Id: default May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Project-Domain-Name: Default May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Project-Id: 76a4e041bd164458a5b1a262dc443e9c May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Project-Name: admin May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Role: member,reader,admin May 26 16:45:52.461558 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Roles: member,reader,admin May 26 16:45:52.463499 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76a4e041bd164458a5b1a262dc443e9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76a4e041bd164458a5b1a262dc443e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76a4e041bd164458a5b1a262dc443e9c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76a4e041bd164458a5b1a262dc443e9c"}]}] May 26 16:45:52.463499 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Tenant: admin May 26 16:45:52.463499 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Tenant-Id: 76a4e041bd164458a5b1a262dc443e9c May 26 16:45:52.463499 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Tenant-Name: admin May 26 16:45:52.463499 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-User: admin May 26 16:45:52.463499 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-User-Domain-Id: default May 26 16:45:52.463499 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-User-Domain-Name: Default May 26 16:45:52.463499 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-User-Id: ea68495bc01f41d2b0c2e34799485fee May 26 16:45:52.463499 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-User-Name: admin May 26 16:45:52.463499 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: method: > May 26 16:45:52.463499 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: exception: Flavor 84 could not be found. May 26 16:45:52.463499 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: action_args: {'id': '84'} May 26 16:45:52.463499 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:45:52.463499 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:45:52.465228 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi May 26 16:45:52.473031 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-b7e23d6c-1ae2-4574-9236-9fb15d68873b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:45:52.474246 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-b7e23d6c-1ae2-4574-9236-9fb15d68873b admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.070642 May 26 16:45:52.474246 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Thu May 26 16:45:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 16:45:52.474443 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-c18c30b0-a2f4-45a5-be2e-5455e5f73d3c admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:52.493602 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-c18c30b0-a2f4-45a5-be2e-5455e5f73d3c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022937 May 26 16:45:52.494157 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Thu May 26 16:45:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:52.508148 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-b7132929-d9ee-470a-92eb-c1cdbf67daf8 admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:52.523271 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-b7132929-d9ee-470a-92eb-c1cdbf67daf8 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019046 May 26 16:45:52.523836 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Thu May 26 16:45:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:52.533550 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-a3f6cf47-608d-4e71-925d-88ee5e1cc5ea admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:52.539959 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.wsgi [None req-a3f6cf47-608d-4e71-925d-88ee5e1cc5ea admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-a3f6cf47-608d-4e71-925d-88ee5e1cc5ea admin admin] Request method failure captured: May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Accept: application/json May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Accept-Encoding: gzip, deflate May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Connection: keep-alive May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Content-Length: 0 May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Host: 10.222.0.48 May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Openstack-Api-Version: compute 2.90 May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Openstack-System-Scope: None May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: User-Agent: python-novaclient May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Auth-Token: gAAAAABij67A1nbNEns9BnzibnMrjwX_-tc9shMoaJXmhx6njIKhsfpE07K7Fps1aeeAZjhb_mhyQnQ2Avsv1QeECXTHq4PxcbZDN2HUxm9UDwm9vDZo8Ant9dT90Asq7lWOBlzMifVoROgJ418-YTITuFovbWzZlXE8Cbz54zxISVtxTuafWao May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Domain-Id: None May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Domain-Name: None May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Identity-Status: Confirmed May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Is-Admin-Project: True May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Project-Domain-Id: default May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Project-Domain-Name: Default May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Project-Id: 76a4e041bd164458a5b1a262dc443e9c May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Project-Name: admin May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Role: member,reader,admin May 26 16:45:52.541663 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Roles: member,reader,admin May 26 16:45:52.544191 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76a4e041bd164458a5b1a262dc443e9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76a4e041bd164458a5b1a262dc443e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76a4e041bd164458a5b1a262dc443e9c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76a4e041bd164458a5b1a262dc443e9c"}]}] May 26 16:45:52.544191 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Tenant: admin May 26 16:45:52.544191 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Tenant-Id: 76a4e041bd164458a5b1a262dc443e9c May 26 16:45:52.544191 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Tenant-Name: admin May 26 16:45:52.544191 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-User: admin May 26 16:45:52.544191 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-User-Domain-Id: default May 26 16:45:52.544191 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-User-Domain-Name: Default May 26 16:45:52.544191 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-User-Id: ea68495bc01f41d2b0c2e34799485fee May 26 16:45:52.544191 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-User-Name: admin May 26 16:45:52.544191 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: method: > May 26 16:45:52.544191 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: exception: Flavor 84 could not be found. May 26 16:45:52.544191 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: action_args: {'id': '84'} May 26 16:45:52.544191 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:45:52.544191 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:45:52.546193 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi May 26 16:45:52.548374 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-a3f6cf47-608d-4e71-925d-88ee5e1cc5ea admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:45:52.550638 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-a3f6cf47-608d-4e71-925d-88ee5e1cc5ea admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013168 May 26 16:45:52.550638 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Thu May 26 16:45:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 16:45:53.439199 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-b7132929-d9ee-470a-92eb-c1cdbf67daf8 admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:53.448840 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-b7132929-d9ee-470a-92eb-c1cdbf67daf8 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 26 16:45:53.448840 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 26 16:45:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:53.651140 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-b657623c-feaa-44cb-9b68-dd6302e301ed admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:53.657039 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.wsgi [None req-b657623c-feaa-44cb-9b68-dd6302e301ed admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-b657623c-feaa-44cb-9b68-dd6302e301ed admin admin] Request method failure captured: May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Accept: application/json May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Accept-Encoding: gzip, deflate May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Connection: keep-alive May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Content-Length: 0 May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Host: 10.222.0.48 May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Openstack-Api-Version: compute 2.90 May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Openstack-System-Scope: None May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: User-Agent: python-novaclient May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Auth-Token: gAAAAABij67BXXly5se-cDN5qpSMrb6cToWSdLmC_Ya7MAlYao0k4zyE6XfWTJihgWk-7XQLQlkb96FnDqxDtH8FlSkZ72TcS4FWUieR-iqpe_6Oey8hRjdMEXtW3vPq_kbi_FX5bc6bbF7HWTdcIzn8uR-w-6r4M6kIx2zC8WzKuFy4XN_fnRc May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Domain-Id: None May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Domain-Name: None May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Identity-Status: Confirmed May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Is-Admin-Project: True May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Project-Domain-Id: default May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Project-Domain-Name: Default May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Project-Id: 76a4e041bd164458a5b1a262dc443e9c May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Project-Name: admin May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Role: member,reader,admin May 26 16:45:53.658592 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Roles: member,reader,admin May 26 16:45:53.660152 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76a4e041bd164458a5b1a262dc443e9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76a4e041bd164458a5b1a262dc443e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76a4e041bd164458a5b1a262dc443e9c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76a4e041bd164458a5b1a262dc443e9c"}]}] May 26 16:45:53.660152 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Tenant: admin May 26 16:45:53.660152 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Tenant-Id: 76a4e041bd164458a5b1a262dc443e9c May 26 16:45:53.660152 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-Tenant-Name: admin May 26 16:45:53.660152 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-User: admin May 26 16:45:53.660152 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-User-Domain-Id: default May 26 16:45:53.660152 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-User-Domain-Name: Default May 26 16:45:53.660152 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-User-Id: ea68495bc01f41d2b0c2e34799485fee May 26 16:45:53.660152 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: X-User-Name: admin May 26 16:45:53.660152 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: method: > May 26 16:45:53.660152 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: exception: Flavor 451 could not be found. May 26 16:45:53.660152 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: action_args: {'id': '451'} May 26 16:45:53.660152 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:45:53.660152 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:45:53.661011 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: ERROR nova.api.openstack.wsgi May 26 16:45:53.662117 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-b657623c-feaa-44cb-9b68-dd6302e301ed admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:45:53.663234 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-b657623c-feaa-44cb-9b68-dd6302e301ed admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.065295 May 26 16:45:53.663234 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Thu May 26 16:45:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 16:45:53.670358 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-aa2a00f5-46d8-4fda-bcc9-d6a342ca9dcd admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:53.686619 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-aa2a00f5-46d8-4fda-bcc9-d6a342ca9dcd admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019864 May 26 16:45:53.687186 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Thu May 26 16:45:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:53.697549 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-5c590d04-73b3-4add-87bb-59a3813f0c6a admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:53.711727 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-5c590d04-73b3-4add-87bb-59a3813f0c6a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017733 May 26 16:45:53.712294 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Thu May 26 16:45:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:45:53.722304 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-18fc2b85-f78b-4861-abf9-1b35c819358d admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:53.727829 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.wsgi [None req-18fc2b85-f78b-4861-abf9-1b35c819358d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-18fc2b85-f78b-4861-abf9-1b35c819358d admin admin] Request method failure captured: May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Accept: application/json May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Accept-Encoding: gzip, deflate May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Connection: keep-alive May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Content-Length: 0 May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Host: 10.222.0.48 May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Openstack-Api-Version: compute 2.90 May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Openstack-System-Scope: None May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: User-Agent: python-novaclient May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Auth-Token: gAAAAABij67BXXly5se-cDN5qpSMrb6cToWSdLmC_Ya7MAlYao0k4zyE6XfWTJihgWk-7XQLQlkb96FnDqxDtH8FlSkZ72TcS4FWUieR-iqpe_6Oey8hRjdMEXtW3vPq_kbi_FX5bc6bbF7HWTdcIzn8uR-w-6r4M6kIx2zC8WzKuFy4XN_fnRc May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Domain-Id: None May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Domain-Name: None May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Identity-Status: Confirmed May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Is-Admin-Project: True May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Openstack-Nova-Api-Version: 2.90 May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Project-Domain-Id: default May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Project-Domain-Name: Default May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Project-Id: 76a4e041bd164458a5b1a262dc443e9c May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Project-Name: admin May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Role: member,reader,admin May 26 16:45:53.729374 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Roles: member,reader,admin May 26 16:45:53.730994 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76a4e041bd164458a5b1a262dc443e9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/76a4e041bd164458a5b1a262dc443e9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_76a4e041bd164458a5b1a262dc443e9c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/76a4e041bd164458a5b1a262dc443e9c"}]}] May 26 16:45:53.730994 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Tenant: admin May 26 16:45:53.730994 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Tenant-Id: 76a4e041bd164458a5b1a262dc443e9c May 26 16:45:53.730994 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-Tenant-Name: admin May 26 16:45:53.730994 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-User: admin May 26 16:45:53.730994 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-User-Domain-Id: default May 26 16:45:53.730994 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-User-Domain-Name: Default May 26 16:45:53.730994 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-User-Id: ea68495bc01f41d2b0c2e34799485fee May 26 16:45:53.730994 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: X-User-Name: admin May 26 16:45:53.730994 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: method: > May 26 16:45:53.730994 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: exception: Flavor 451 could not be found. May 26 16:45:53.730994 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: action_args: {'id': '451'} May 26 16:45:53.730994 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:45:53.730994 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:45:53.732293 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: ERROR nova.api.openstack.wsgi May 26 16:45:53.734312 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-18fc2b85-f78b-4861-abf9-1b35c819358d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:45:53.735702 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-18fc2b85-f78b-4861-abf9-1b35c819358d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012223 May 26 16:45:53.735702 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Thu May 26 16:45:53 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 16:45:54.629048 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-5c590d04-73b3-4add-87bb-59a3813f0c6a admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:54.630418 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-5c590d04-73b3-4add-87bb-59a3813f0c6a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002077 May 26 16:45:54.630960 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 26 16:45:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:54.826351 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-0725b1f3-f108-4dac-b427-aa0c9c0139ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:54.936510 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-0725b1f3-f108-4dac-b427-aa0c9c0139ca admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.164489 May 26 16:45:54.937077 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Thu May 26 16:45:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 16:45:55.830192 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-5c590d04-73b3-4add-87bb-59a3813f0c6a admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:55.831206 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-5c590d04-73b3-4add-87bb-59a3813f0c6a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 26 16:45:55.831632 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 26 16:45:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:56.022614 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-283b2765-34f3-419d-9a5f-e07a726c9ceb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:56.109573 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-283b2765-34f3-419d-9a5f-e07a726c9ceb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.140341 May 26 16:45:56.110115 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Thu May 26 16:45:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:45:56.992520 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-5c590d04-73b3-4add-87bb-59a3813f0c6a admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:56.993634 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-5c590d04-73b3-4add-87bb-59a3813f0c6a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 26 16:45:56.994024 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 26 16:45:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:57.192083 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-46519b5a-0dd6-4750-b99f-de294beb3f3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:57.295302 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-46519b5a-0dd6-4750-b99f-de294beb3f3b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.158282 May 26 16:45:57.295859 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Thu May 26 16:45:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:45:58.179847 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-5c590d04-73b3-4add-87bb-59a3813f0c6a admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:58.181168 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-5c590d04-73b3-4add-87bb-59a3813f0c6a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001718 May 26 16:45:58.181612 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 26 16:45:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:58.374581 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-b2eff857-4d1c-4a23-8d5f-bb867120d784 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:45:58.470290 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-b2eff857-4d1c-4a23-8d5f-bb867120d784 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.147812 May 26 16:45:58.470840 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Thu May 26 16:45:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:45:59.355287 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-5c590d04-73b3-4add-87bb-59a3813f0c6a admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:59.356296 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-5c590d04-73b3-4add-87bb-59a3813f0c6a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 May 26 16:45:59.356682 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 26 16:45:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:45:59.551328 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-ef2fda26-3031-4d7c-88e3-1e024c5e6ef3 admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:45:59.571597 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-ef2fda26-3031-4d7c-88e3-1e024c5e6ef3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076304 May 26 16:45:59.572163 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Thu May 26 16:45:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:47:05.510021 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-5c590d04-73b3-4add-87bb-59a3813f0c6a admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:05.511034 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-5c590d04-73b3-4add-87bb-59a3813f0c6a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 May 26 16:47:05.511433 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Thu May 26 16:47:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:47:05.519349 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG dbcounter [-] [110354] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:05.575229 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-547e48f4-fb3b-4e15-8515-73446f399bb6 admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:05.595847 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-547e48f4-fb3b-4e15-8515-73446f399bb6 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077852 May 26 16:47:05.596421 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Thu May 26 16:47:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:47:05.617792 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG dbcounter [-] [110355] Writing DB stats nova_api:SELECT=15 {{(pid=110355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:05.621536 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-fd799d11-2c85-4435-b999-c597c4bd0453 admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:05.630230 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-fd799d11-2c85-4435-b999-c597c4bd0453 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013824 May 26 16:47:05.630788 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Thu May 26 16:47:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:05.646621 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-93d235ac-3b8f-4ac0-a8de-bba63c02cc2d admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:05.655588 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-93d235ac-3b8f-4ac0-a8de-bba63c02cc2d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013317 May 26 16:47:05.656147 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Thu May 26 16:47:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:05.668408 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-0245349a-2164-43d4-bf4b-b45cdbe30fd4 admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:05.677542 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-0245349a-2164-43d4-bf4b-b45cdbe30fd4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013113 May 26 16:47:05.678194 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Thu May 26 16:47:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:47:05.694842 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-38c42400-278a-4838-8315-6ab2e12714a2 admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:47:05.702986 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-38c42400-278a-4838-8315-6ab2e12714a2 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012048 May 26 16:47:05.703574 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Thu May 26 16:47:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:51:09.659678 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-0245349a-2164-43d4-bf4b-b45cdbe30fd4 admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:09.660716 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-0245349a-2164-43d4-bf4b-b45cdbe30fd4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 May 26 16:51:09.661121 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 26 16:51:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:51:09.826300 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG dbcounter [-] [110354] Writing DB stats nova_api:SELECT=6 {{(pid=110354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:09.946214 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-d5a89006-2153-417c-9254-daa91727e711 admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:09.947509 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:51:09.947509 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: warnings.warn(msg) May 26 16:51:09.949936 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-d5a89006-2153-417c-9254-daa91727e711 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:09.949936 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-d5a89006-2153-417c-9254-daa91727e711 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:09.950491 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-d5a89006-2153-417c-9254-daa91727e711 admin admin] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:09.950939 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-d5a89006-2153-417c-9254-daa91727e711 admin admin] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:09.986429 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-d5a89006-2153-417c-9254-daa91727e711 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.165901 May 26 16:51:09.987001 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Thu May 26 16:51:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:51:10.889628 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-0245349a-2164-43d4-bf4b-b45cdbe30fd4 admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:10.890606 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-0245349a-2164-43d4-bf4b-b45cdbe30fd4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 May 26 16:51:10.891002 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 26 16:51:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:51:11.094247 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-30ca46c0-4e76-4b51-b6f4-1827cb2b46a6 admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:11.095406 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:51:11.095406 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: warnings.warn(msg) May 26 16:51:11.096632 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-30ca46c0-4e76-4b51-b6f4-1827cb2b46a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:11.097092 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-30ca46c0-4e76-4b51-b6f4-1827cb2b46a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:11.097929 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-30ca46c0-4e76-4b51-b6f4-1827cb2b46a6 admin admin] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:11.098361 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-30ca46c0-4e76-4b51-b6f4-1827cb2b46a6 admin admin] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:11.125489 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-30ca46c0-4e76-4b51-b6f4-1827cb2b46a6 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.096528 May 26 16:51:11.126073 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Thu May 26 16:51:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:51:22.463028 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-0245349a-2164-43d4-bf4b-b45cdbe30fd4 admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:22.464103 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-0245349a-2164-43d4-bf4b-b45cdbe30fd4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 26 16:51:22.464513 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 26 16:51:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:51:22.613754 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG dbcounter [-] [110354] Writing DB stats nova_cell0:SELECT=4 {{(pid=110354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:22.614624 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG dbcounter [-] [110354] Writing DB stats nova_cell1:SELECT=4 {{(pid=110354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:22.615303 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG dbcounter [-] [110354] Writing DB stats nova_api:SELECT=8 {{(pid=110354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:22.673002 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-ca26793b-895d-4cb2-8d3e-de3e2054217d admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:22.674407 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:51:22.674407 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: warnings.warn(msg) May 26 16:51:22.675781 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-ca26793b-895d-4cb2-8d3e-de3e2054217d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:22.676234 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-ca26793b-895d-4cb2-8d3e-de3e2054217d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:22.677121 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-ca26793b-895d-4cb2-8d3e-de3e2054217d admin admin] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:22.677606 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-ca26793b-895d-4cb2-8d3e-de3e2054217d admin admin] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:22.705857 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-ca26793b-895d-4cb2-8d3e-de3e2054217d admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.096726 May 26 16:51:22.706440 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Thu May 26 16:51:22 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:51:23.627699 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: DEBUG nova.api.openstack.wsgi [None req-0245349a-2164-43d4-bf4b-b45cdbe30fd4 admin admin] Calling method '>' {{(pid=110355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:23.628739 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: INFO nova.api.openstack.requestlog [None req-0245349a-2164-43d4-bf4b-b45cdbe30fd4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 May 26 16:51:23.629168 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: [pid: 110355|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Thu May 26 16:51:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:51:23.827855 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG nova.api.openstack.wsgi [None req-cfd8570b-ded1-4532-b972-a92b018191e5 admin admin] Calling method '>' {{(pid=110354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:51:23.829052 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:51:23.829052 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: warnings.warn(msg) May 26 16:51:23.830307 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-cfd8570b-ded1-4532-b972-a92b018191e5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:23.830747 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-cfd8570b-ded1-4532-b972-a92b018191e5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:23.831521 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-cfd8570b-ded1-4532-b972-a92b018191e5 admin admin] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:51:23.831939 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: DEBUG oslo_concurrency.lockutils [None req-cfd8570b-ded1-4532-b972-a92b018191e5 admin admin] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:51:23.854503 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: INFO nova.api.openstack.requestlog [None req-cfd8570b-ded1-4532-b972-a92b018191e5 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087225 May 26 16:51:23.855079 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: [pid: 110354|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Thu May 26 16:51:23 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:52:24.178017 dv-cinder-836070-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 16:52:24.182872 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: Thu May 26 16:52:24 2022 - graceful shutdown triggered... May 26 16:52:24.184119 dv-cinder-836070-4-iscsi devstack@n-api.service[110354]: Gracefully killing worker 1 (pid: 110354)... May 26 16:52:24.184483 dv-cinder-836070-4-iscsi devstack@n-api.service[110355]: Gracefully killing worker 2 (pid: 110355)... May 26 16:52:25.179458 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: worker 1 buried after 1 seconds May 26 16:52:25.179458 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: worker 2 buried after 1 seconds May 26 16:52:25.179458 dv-cinder-836070-4-iscsi devstack@n-api.service[110353]: goodbye to uWSGI. May 26 16:52:25.181081 dv-cinder-836070-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 16:52:25.181686 dv-cinder-836070-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 16:52:25.184439 dv-cinder-836070-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 16:52:25.200809 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 16:52:25.213104 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 16:52:25 2022] *** May 26 16:52:25.213104 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 16:52:25.213104 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 16:52:25.213104 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: nodename: dv-cinder-836070-4-iscsi May 26 16:52:25.213104 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: machine: x86_64 May 26 16:52:25.213104 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: clock source: unix May 26 16:52:25.213104 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: pcre jit disabled May 26 16:52:25.213104 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: detected number of CPU cores: 4 May 26 16:52:25.213104 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: current working directory: / May 26 16:52:25.213104 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: detected binary path: /usr/bin/uwsgi-core May 26 16:52:25.213104 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: your processes number limit is 47680 May 26 16:52:25.214019 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: your memory page size is 4096 bytes May 26 16:52:25.214019 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: detected max file descriptor number: 2048 May 26 16:52:25.214019 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: lock engine: pthread robust mutexes May 26 16:52:25.214019 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: thunder lock: enabled May 26 16:52:25.214019 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 16:52:25.214019 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 16:52:25.260302 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: Python main interpreter initialized at 0x558f9f2039c0 May 26 16:52:25.260302 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: python threads support enabled May 26 16:52:25.260302 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: your server socket listen backlog is limited to 100 connections May 26 16:52:25.260302 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: your mercy for graceful operations on workers is 90 seconds May 26 16:52:25.260772 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: mapped 403077 bytes (393 KB) for 2 cores May 26 16:52:25.260772 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: *** Operational MODE: preforking *** May 26 16:52:25.261051 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: *** uWSGI is running in multiple interpreter mode *** May 26 16:52:25.261051 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: spawned uWSGI master process (pid: 124821) May 26 16:52:25.261252 dv-cinder-836070-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 16:52:25.262233 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: spawned uWSGI worker 1 (pid: 124836, cores: 1) May 26 16:52:25.262233 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: spawned uWSGI worker 2 (pid: 124837, cores: 1) May 26 16:52:25.262441 dv-cinder-836070-4-iscsi devstack@n-api.service[124821]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 16:52:26.501015 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 16:52:26.506095 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 16:52:27.333753 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:52:27.333753 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: from cryptography.utils import int_from_bytes May 26 16:52:27.334038 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:52:27.334038 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: from cryptography.utils import int_from_bytes May 26 16:52:27.337657 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:52:27.337657 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: from cryptography.utils import int_from_bytes May 26 16:52:27.337998 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:52:27.337998 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: from cryptography.utils import int_from_bytes May 26 16:52:29.907091 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:52:29.907708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:52:29.907821 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:52:29.908150 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:52:29.908409 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:52:29.908811 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.909141 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.909488 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.909815 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.910151 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.910465 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.910793 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.911149 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.911515 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.911867 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.912101 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.912431 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836070-4-iscsi {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.912756 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.913070 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.913409 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.913632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:52:29.914034 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.914123 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:52:29.914225 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.914348 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.914478 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:52:29.914659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.914777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:52:29.915032 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:52:29.915143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.915430 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.915593 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.915766 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.915923 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.916098 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.916222 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.916430 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.916555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.916760 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.916883 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.917613 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.917769 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.917980 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.918099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.918312 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.918414 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.918652 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.918766 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.919045 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.919206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.919416 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.919527 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836070-4-iscsi {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.919754 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836070-4-iscsi {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.919860 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.920076 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.920225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.920396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.920613 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.920709 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.920807 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.921039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.921190 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.921367 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.921471 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.921702 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.921841 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.922019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.922215 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.922579 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.925656 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.925656 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.925992 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.926142 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.926295 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.927536 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.927646 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.927743 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.927829 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.927919 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.928014 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.928014 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.928192 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.928284 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.928368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.928457 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.928545 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.928642 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.928727 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.928809 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.928898 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.929006 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.929100 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836070-4-iscsi {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.929192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.930203 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.930545 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.930709 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.930816 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.930911 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.931002 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.931002 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.931187 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.931280 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.931387 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.931485 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.931585 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.931871 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.931979 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.932079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.932164 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.932253 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.932337 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.932425 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.932509 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.932674 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.932822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.933447 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.933537 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.933659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.933811 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.933978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.934178 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.934324 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.934454 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.934651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.934806 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.934937 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.935067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.935190 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.935327 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.935468 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.935628 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.935770 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.935917 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.935917 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.936212 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.936212 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.936473 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.936570 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.936656 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.936739 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.936824 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.936987 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.937085 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.937228 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.937375 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.937464 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.937547 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.937639 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.937724 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.937815 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.937905 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.937989 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.938079 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.938176 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.938262 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.938344 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.938427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.938520 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.938612 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.938702 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.938794 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.938884 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.938978 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.939070 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.939167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.939258 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.939350 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.939440 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.939586 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.939683 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.939781 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.939884 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.939970 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.940052 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.940052 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.940214 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.940360 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.940457 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.940550 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.940635 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.940717 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.940799 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.940890 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.941067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.941167 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.941418 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.941524 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.941727 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.941848 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.942039 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.942143 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.942342 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.942442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.942664 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.942756 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.942979 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.943071 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.943287 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.943385 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.943594 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.943687 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.943901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.944005 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.944209 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.944302 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.944470 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.944568 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.944781 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.944882 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.945095 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.945188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.945475 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.945580 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.945788 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.945887 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.946095 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.946201 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.946420 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.946512 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.946727 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.946825 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.947033 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.947169 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.947345 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.947436 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.947645 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.947743 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.947954 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.948045 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.948263 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.948361 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.948604 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.948706 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.948912 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.949010 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.949224 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.949349 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.949561 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.949652 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.949868 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.949970 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.950174 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.950278 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.950478 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.950576 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.950806 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.950904 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.951121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.951230 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.951434 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.951533 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.951760 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.951851 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.952129 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.952232 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.952380 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.952520 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.952705 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.952824 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.953019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.953162 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.953379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.953488 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.953688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.953831 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.954118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.954263 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.954437 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.954562 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.954766 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.954854 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.955074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.955186 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.955390 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.955510 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.955716 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.955827 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.956032 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.956229 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.956496 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.956599 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.957744 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.957854 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.957854 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.958035 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.958117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.958239 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.958346 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.958462 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.958571 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.958686 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.958820 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.958930 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.959041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.959164 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.959278 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.959395 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.959511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.961342 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.961479 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.961570 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.961645 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.961717 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.962306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.962390 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.962518 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:52:29.962635 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.962777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.962913 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.963023 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.963109 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.963208 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.963286 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.963390 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.963476 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.963549 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.963629 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.963730 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.963805 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.963877 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.963877 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.964031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.964118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.964192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.964264 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.964381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.964845 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.964965 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.965049 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.965128 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.965502 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.965772 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.965874 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.966175 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.966277 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.966501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.966806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.966909 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.967139 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.967312 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.967479 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.968033 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.968139 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.968371 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.968602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.968707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.969130 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.969237 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.969477 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.969732 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.969849 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.970201 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.970307 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.970536 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.970790 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.970930 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.971188 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.971365 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.971521 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.971824 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.972762 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.972867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.972958 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.973034 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.973034 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.973164 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.973242 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.973560 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.973714 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.973852 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.973987 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.974121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.974254 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.974404 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.974543 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.974688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.974837 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.975240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.975404 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.975563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.975706 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.975825 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.975960 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.976103 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.976274 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.976424 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.976555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.976683 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.976850 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.976989 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.977134 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.977304 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.977436 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.977589 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.977726 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.977872 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.978116 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.978256 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.978405 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.980308 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.980582 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.980823 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.981084 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.981591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.981888 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.982371 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.982612 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.982873 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.983121 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.983377 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.983619 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.983864 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.984102 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.984357 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.984615 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.984847 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.985078 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.985333 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.985567 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.985823 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.986078 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.986323 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.986557 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.986800 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.987028 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.987273 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.987507 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.987742 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.987982 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.988232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.988482 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.988726 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.988967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.989279 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.990135 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.990438 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.990900 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.991270 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.991449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.991729 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.991892 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.992052 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.992235 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.992590 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.992761 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.992922 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.993088 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.993239 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.993482 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.993637 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.993795 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.993990 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.994142 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.994300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.994462 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.994631 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.994791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.994791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.995106 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.995273 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.996002 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.996175 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.996328 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.996523 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.996679 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.996846 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.996998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.997157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.997327 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.997504 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.997656 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.997837 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.997990 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.998149 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.998309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.998526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.998780 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.998780 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.999223 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.999434 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:29.999661 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.000376 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.000376 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.000841 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.001354 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.001354 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.001659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.001917 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.001917 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.002239 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.002392 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.002737 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.002913 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.002913 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.003297 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.003546 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.003546 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.004026 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.004273 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.004528 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.004788 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.005042 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.005330 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.005527 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.005690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.005690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.006004 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.006164 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.006164 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.006474 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.006635 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.006635 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.006939 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.007096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.007258 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.007418 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.007418 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.007714 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.007999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.007999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.008359 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.008512 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.008674 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.008838 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.008838 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.009134 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.009334 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.009334 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.009685 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.009858 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.010010 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.010401 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.010401 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.010821 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.011025 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.011217 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.011613 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.011613 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.012130 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.012376 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.012655 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.013176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.013442 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.013605 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.013826 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.014087 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.014359 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.014614 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.014824 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.014987 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.015148 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.015300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.015481 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.015654 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.015839 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.015995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.016146 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.016295 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.016460 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.016613 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.016765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.016934 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.017086 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.017245 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.017475 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.017634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.017795 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.017946 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.018096 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.018260 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.018412 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.018562 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.018722 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.018881 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.019057 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.019218 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.019378 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.019535 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.019713 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.019918 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.020127 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.020633 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.020937 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.021097 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.021249 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.021439 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.021872 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.022060 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.022310 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.022475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.022635 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.022797 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.023210 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.023382 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.023610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.023915 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.024165 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.024422 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.024678 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.025003 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.025280 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.025525 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.025772 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.025959 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.025959 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.026279 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.026440 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.026769 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.026932 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.027094 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.027248 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.027399 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.027562 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.027727 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.027886 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.028060 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.028221 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.028381 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.028600 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.028765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.028765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.029063 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.029227 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.029438 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.029602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.029772 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.029933 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.030098 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.030258 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.030409 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.030580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.030968 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.031262 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.031422 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.031573 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.031753 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.032153 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.032461 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.032642 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.032805 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.032965 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.033432 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.033693 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.033944 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.034207 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.034466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.034730 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.034967 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.035175 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.035432 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.035702 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.035932 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.036185 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.036425 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.036598 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.036761 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.036936 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.037089 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.037241 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.037447 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.037608 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.037776 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.037936 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.038106 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.038265 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.038417 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.038576 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.038737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.038890 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.039048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.039219 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.039385 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.039545 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.039545 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.039852 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.040004 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.040165 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.040324 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.040489 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.040489 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.040807 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.041203 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.041523 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.041694 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.041861 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.042031 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.043065 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.043295 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.043724 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.043889 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.044054 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.044217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.044381 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.044691 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.044858 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.045054 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.045216 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.045404 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.045569 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.045730 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.045891 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.046139 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.046373 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.046373 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.046779 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.046985 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.047197 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.047401 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.047639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.047879 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.048114 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.048445 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.048697 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.048997 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.050364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.050660 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.050927 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.051597 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.052048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.052326 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.052669 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.053382 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.053951 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.054138 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.054299 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.054501 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.054701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.054989 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.055162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.055316 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.055518 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.055708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.055871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.056023 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.056187 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.056349 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.056503 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.056669 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.056821 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.056992 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.057155 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.057327 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.057496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.057660 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.058414 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.058585 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.058740 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.058740 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.059038 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.059203 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.059363 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.059523 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.059696 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.059848 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.060013 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.060263 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.060538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.060733 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.060931 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.061133 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.061748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.062176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.062388 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.062578 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.062776 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.062987 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.063584 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.064037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.064252 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.064452 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.064643 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.064833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.065157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.065394 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.065711 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.069312 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.069517 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.069709 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.069877 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.069877 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.070190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.070350 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.070529 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.070827 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.070994 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.071147 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.071308 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.071462 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.071858 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.072036 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.072228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.072514 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.072680 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.072833 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.072992 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.073154 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.073370 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.073647 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.073827 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.074297 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.074482 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.074668 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.074836 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.075016 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.075285 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.075477 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.075679 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.075838 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.076029 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.076200 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.076200 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.076508 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.076817 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.076983 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.076983 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.077390 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.077564 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.077728 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.077910 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.078074 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.078226 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.078377 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.078529 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.078696 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.078849 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.079001 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.079001 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.079304 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.079457 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.079636 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.079636 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.079934 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.080085 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.080243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.080243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.080650 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.080650 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.081125 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.081125 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.081651 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.082246 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.082554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.082554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.083233 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.083482 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.083482 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.084144 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.084820 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.084820 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.085224 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.085569 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.085766 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.085978 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.086183 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.086396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.086613 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.086613 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.087010 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.087234 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.087411 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.087564 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.087734 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.087901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.088113 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.088304 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.088459 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.088621 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.088816 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.089021 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.089898 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.090073 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.090236 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.090399 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.090552 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.090704 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.090868 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.091050 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.091204 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.091365 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.092403 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.092633 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.093052 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.093219 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.093399 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.093563 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.093723 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.094131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.094294 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.094710 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.095009 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.095176 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.095330 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.095525 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.095784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.095941 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.096102 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.096255 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.096422 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.096582 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.096734 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.096884 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.097042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.097194 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.097429 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.097604 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.097769 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.097928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.098089 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.098243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.098403 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.098564 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.098839 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.098996 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.099147 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.099297 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.099456 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.099609 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.099760 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.099930 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.100083 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.100248 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.100400 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.100551 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.100710 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.100868 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.101028 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.101189 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.101383 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.101547 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.101700 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.101861 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.102012 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.102177 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.102579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.102739 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.102900 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.103052 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.103218 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.103385 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.103544 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.103706 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.103857 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.104034 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.104440 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.105471 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.105639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.105824 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.106075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.106075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.106393 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.106545 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.106697 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.106857 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.106857 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.107154 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.107318 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.107318 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.107318 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.107753 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.107914 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.108065 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.108299 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.108299 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.108620 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.108780 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.108940 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.109105 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.109334 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.109510 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.109675 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.109842 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.109996 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.110161 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.110321 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.110480 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.110640 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.110792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.110792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.111089 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.111243 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.111401 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.111563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.111715 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.111866 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.112026 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.112026 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.112325 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.112495 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.112869 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.113043 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.113197 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.113377 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.113542 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.113695 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.113695 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.114095 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.114253 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.114665 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.114826 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.114986 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.115148 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.115547 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.115837 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.116010 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.116010 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.116435 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.116610 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.116774 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.116933 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.117085 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.117236 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.117468 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.117638 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.117797 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.117948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.118109 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.118271 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.118432 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.118584 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.118584 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.118891 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.119041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.119041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.119352 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.119513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.119513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.119817 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.119977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.120138 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.120917 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.121081 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.121233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.121233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.121580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.121742 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.121895 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.122045 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.122197 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.122347 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.122497 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.122658 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.123042 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.123212 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.123381 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.123534 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.123708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.123861 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.124013 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.124172 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.124332 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.124492 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.124909 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.125071 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.125240 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.125443 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.125443 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.126076 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.126275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.126522 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.126688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.126842 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.126993 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.127143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.127306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.127460 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.127618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.127778 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.127938 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.128099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.128099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.128407 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.128562 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.128721 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.128875 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.129035 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.129189 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.129467 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.129632 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.129784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.129945 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.130111 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.130272 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.130425 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.130588 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.130739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.130905 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.131069 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.131069 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.131356 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.131515 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.131515 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.131817 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.131976 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.132137 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.132297 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.132297 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.132605 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.132778 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.132778 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.133336 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.133511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.133672 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.133831 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.134035 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.134273 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.134507 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.134780 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.136959 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.137246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.137497 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.137669 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.137830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.137985 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.137985 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.138293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.138458 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.138611 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.138762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.138912 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.139064 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.139224 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.139398 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.139551 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.139702 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.139861 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.140012 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.140181 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.140342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.140504 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.140664 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.140816 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.140973 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.141205 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.141398 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.141573 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.141745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.142094 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.142270 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.142423 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.142576 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.142728 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.142878 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.143030 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.143209 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.143577 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.143746 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.143900 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.144074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.144236 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.144398 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.144558 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.144720 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.144881 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.145033 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.145205 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.146150 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.146327 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.146490 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.146663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.147116 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.147295 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.147450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.147611 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.147781 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.147935 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.147935 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.148246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.148399 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.148550 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.148708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.148862 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.149021 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.149200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.149421 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.149421 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.149723 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.149723 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.150023 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.150182 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.150182 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.150486 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.150644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.150644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.150948 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.151099 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.151261 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.151421 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.151641 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.152348 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.152555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.152799 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.153045 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.153298 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.153784 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.154006 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.154250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.154498 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.154762 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.155011 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.155278 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.155560 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.155932 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.156442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.156773 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.157655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.157920 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.158170 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.158410 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.158623 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.158623 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.159083 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.159343 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.159606 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.159861 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.160109 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.160340 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.160571 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.160799 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.161020 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.161627 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.161890 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.162151 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.162399 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.162770 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.163003 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.163247 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.163492 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.163766 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.164305 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.164556 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.164797 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.165015 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.165238 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.165531 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.166149 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.166588 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.166806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.166986 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.167185 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.167509 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.167827 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.167827 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.168130 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.168130 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.168130 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.168130 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.168130 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.168871 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.169024 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.169176 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.169364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.169536 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.169693 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.169846 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.170009 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.170161 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.170320 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.170481 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.170646 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.170824 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.171075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.171234 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.171387 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.171574 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.171811 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.171970 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.172122 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.172282 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.172448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.172602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.172753 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.172926 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.173087 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.173254 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.173473 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.173635 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.173787 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.173939 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.174323 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.174492 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.174656 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.174816 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.174970 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.174970 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.175276 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.175441 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.175441 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.175743 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.175894 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.176072 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.176321 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.176321 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.176867 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.177029 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.177029 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.177029 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.177655 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.177833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.177987 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.178270 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.178270 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.178576 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.178738 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.178738 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.179051 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.179206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.179359 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.179519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.179519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.179844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.179998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.180149 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.180309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.180469 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.180706 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.180862 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.181014 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.181180 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.181180 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.181518 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.181680 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.181949 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.182107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.182267 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.183073 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.183242 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.183410 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.183564 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.183760 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.183939 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.184100 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.184478 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.184657 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.184811 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.184811 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.185126 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.185336 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.185336 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.185664 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.185818 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.185985 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.186151 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.186331 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.186597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.186775 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.187206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.187367 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.187520 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.187967 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.188129 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.188315 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.188602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.188775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.188930 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.189091 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.189243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.189436 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.189611 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.189766 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.189918 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.190077 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.190237 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.190398 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.190551 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.190551 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.190848 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.191010 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.191171 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.191331 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.191502 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.191662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.191816 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.191984 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.192260 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.192419 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.192571 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.192731 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.192894 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.193055 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.193335 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.193511 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.193734 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.193917 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.194071 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.194237 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.194390 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.194791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.194953 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.195115 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.195268 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.195429 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.195591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.195747 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.195900 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.196062 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.196235 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.196399 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.196925 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.197227 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.197541 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.197699 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.197982 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.198155 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.198309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.199151 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.199322 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.199476 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.199650 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.199805 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.199964 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.200135 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.200951 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.201120 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.201120 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.201555 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.202265 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.202540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.202702 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.202854 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.203016 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.203189 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.203359 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.203539 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.203813 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.205433 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.205433 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.205643 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.205736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.205825 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.205922 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.206019 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.206115 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.206204 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.206280 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.206372 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.206460 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.206555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.206643 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.206731 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.206805 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.206878 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.206966 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.206966 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.207111 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.207197 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.207277 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.207351 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.207442 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.207518 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.207591 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.207663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.207735 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.207807 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.207888 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.207970 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.208045 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.208045 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.208195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.208301 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.208411 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.208493 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.208568 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.208641 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.208722 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.208806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.208881 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.208954 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.209035 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.209117 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.209191 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.209354 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.209442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.209517 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.209598 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.209672 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.209752 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.209850 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.209933 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.210009 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.210089 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.210177 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.210260 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.210342 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.210423 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.210504 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.210578 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.210657 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.210745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.210828 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.210903 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.210975 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.211048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.211127 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.211292 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.211376 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.211451 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.211524 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.211604 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.211604 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.211759 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.211842 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.211916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.211988 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.212060 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.212140 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.212223 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.212299 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.212371 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.212468 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.212551 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.212634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.212709 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.212783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.212865 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.212949 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.213047 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.213141 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.213217 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.213344 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.213431 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.213507 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.213612 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.213699 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.213775 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.213849 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.213929 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.214011 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.214133 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.214221 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.214297 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.214371 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.214443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.214517 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.214598 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.214673 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.214758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.214834 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.214911 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.214992 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.215075 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.215169 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.215243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.215324 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.215405 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.215488 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.215563 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.215644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.215718 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.215798 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.215871 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.215953 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.216028 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.216102 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.216173 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.216245 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.216325 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.216411 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.216493 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.216568 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.216652 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.216732 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.216815 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.216897 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.216972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.217044 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.217116 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.217116 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.217294 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.217374 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.217461 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.217544 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.217628 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.217723 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.218072 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.218150 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.218735 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.218811 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.218884 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.218956 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.219038 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.219123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.219198 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.219277 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.219356 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.219443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.219518 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.219597 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.219678 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.219757 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.219837 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.219929 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.220013 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.220087 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.220160 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.220239 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.220319 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.220412 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.220494 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.220575 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.220649 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.220721 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.220794 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.220878 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.220959 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.221052 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.221134 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.221218 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.221218 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.221506 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.221506 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124836) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:52:30.221650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.221650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.221650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.221650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.221650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.221650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.221650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.221650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222183 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222183 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222183 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222183 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222183 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222183 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222183 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222183 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222701 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222701 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222701 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222701 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222701 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222701 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222701 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.222701 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.223425 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.223425 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.223425 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.223425 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.223425 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.223425 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:52:30.223425 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:52:30.246965 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO dbcounter [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] Registered counter for database nova_api May 26 16:52:30.266553 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO dbcounter [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] Registered counter for database nova_api May 26 16:52:30.271241 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_db.sqlalchemy.engines [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:52:30.279847 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writer thread running {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:52:30.290005 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_db.sqlalchemy.engines [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:52:30.298315 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writer thread running {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:52:30.345503 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.context [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c318fc1c-f63e-4318-9beb-7eb6730543cf(cell1) {{(pid=124836) load_cells /opt/stack/nova/nova/context.py:464}} May 26 16:52:30.350189 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:30.351847 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:30.352725 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:30.355015 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:30.357223 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO dbcounter [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] Registered counter for database nova_cell0 May 26 16:52:30.358962 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.context [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c318fc1c-f63e-4318-9beb-7eb6730543cf(cell1) {{(pid=124837) load_cells /opt/stack/nova/nova/context.py:464}} May 26 16:52:30.361904 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO dbcounter [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] Registered counter for database nova_cell1 May 26 16:52:30.363683 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:30.365462 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:30.366328 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:52:30.368608 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:52:30.369711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_db.sqlalchemy.engines [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:52:30.371308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO dbcounter [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] Registered counter for database nova_cell0 May 26 16:52:30.376002 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO dbcounter [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] Registered counter for database nova_cell1 May 26 16:52:30.376303 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writer thread running {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:52:30.377141 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_db.sqlalchemy.engines [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:52:30.384282 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_db.sqlalchemy.engines [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:52:30.386895 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_db.sqlalchemy.engines [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:52:30.395143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writer thread running {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:52:30.395485 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writer thread running {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:52:30.528861 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writer thread running {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:52:30.538473 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO dbcounter [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] Registered counter for database nova_cell0 May 26 16:52:30.546104 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_db.sqlalchemy.engines [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124836) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:52:30.551145 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writer thread running {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:52:30.553475 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO dbcounter [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] Registered counter for database nova_cell0 May 26 16:52:30.563667 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_db.sqlalchemy.engines [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:52:30.569242 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writer thread running {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:52:30.880944 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: WARNING keystonemiddleware.auth_token [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:52:30.890427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: WARNING keystonemiddleware.auth_token [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:52:30.906057 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: WARNING keystonemiddleware.auth_token [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:52:30.914089 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: WARNING keystonemiddleware.auth_token [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:52:31.236121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: WARNING keystonemiddleware.auth_token [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:52:31.242158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: WARNING keystonemiddleware.auth_token [None req-b235d94b-8f2d-4092-9e6c-bcb05b07bedf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:52:31.247519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558f9f2039c0 pid: 124836 (default app) May 26 16:52:31.269882 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: WARNING keystonemiddleware.auth_token [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 16:52:31.276294 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: WARNING keystonemiddleware.auth_token [None req-12cb2cfd-8a15-4eb2-bda0-41637a0e7356 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 16:52:31.282476 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558f9f2039c0 pid: 124837 (default app) May 26 16:53:15.781767 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=3 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:15.785451 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=3 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:15.785451 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=3 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:15.786210 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=3 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:16.192664 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:16.197883 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:16.197883 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:16.198249 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:17.098291 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c0427bcd-b200-4f47-8898-06c3351eda21 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Action: 'create', calling method: .version_select at 0x7fbe8248fca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2078092381", "metadata": {"Type": "work"}}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c0427bcd-b200-4f47-8898-06c3351eda21 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Request method failure captured: May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 122 May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7B7SSfURrpVo874WyPqSZYtOXIauOqC5dVSeK57QQMgt16fHrAvzY4Cq7cZgYAZQSpQuGWoQIjlSKrfXPVp2tKfa96fjg9TNR1M60zybuK7AXzunv_O_kKJbdZPC01JnVw2gA-kWyWBTLU_Fi5CGnuvMvcpY-e_OtwHbb3IzhON_jI May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 844b7e02c0cd44ffa3716cd2380cca25 May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-VolumesNegativeTest-262757254 May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:53:17.126783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:53:17.129579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/844b7e02c0cd44ffa3716cd2380cca25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/844b7e02c0cd44ffa3716cd2380cca25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_844b7e02c0cd44ffa3716cd2380cca25", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/844b7e02c0cd44ffa3716cd2380cca25"}]}] May 26 16:53:17.129579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-VolumesNegativeTest-262757254 May 26 16:53:17.129579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 844b7e02c0cd44ffa3716cd2380cca25 May 26 16:53:17.129579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-VolumesNegativeTest-262757254 May 26 16:53:17.129579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-VolumesNegativeTest-262757254-project May 26 16:53:17.129579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:53:17.129579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:53:17.129579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 50b0c2f106e443d882ce8b13ebf6f50b May 26 16:53:17.129579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-VolumesNegativeTest-262757254-project May 26 16:53:17.129579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: May 26 16:53:17.129579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2078092381", "metadata": {"Type": "work"}}} May 26 16:53:17.129579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: May 26 16:53:17.129579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2078092381', 'metadata': {'Type': 'work'}}}} May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise error May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi '#$%' May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:53:17.130199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 16:53:17.131121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 16:53:17.132216 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 16:53:17.132216 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.132216 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c0427bcd-b200-4f47-8898-06c3351eda21 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:53:17.133859 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c0427bcd-b200-4f47-8898-06c3351eda21 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.365912 May 26 16:53:17.135147 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1155 bytes} [Thu May 26 16:53:15 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1369 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 16:53:17.148447 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9757cabd-56e1-4b20-99e2-494293db06ee tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Action: 'create', calling method: .version_select at 0x7fbe8233d040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1664988002", "metadata": {"Type": "work"}}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9757cabd-56e1-4b20-99e2-494293db06ee tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Request method failure captured: May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 120 May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7B7SSfURrpVo874WyPqSZYtOXIauOqC5dVSeK57QQMgt16fHrAvzY4Cq7cZgYAZQSpQuGWoQIjlSKrfXPVp2tKfa96fjg9TNR1M60zybuK7AXzunv_O_kKJbdZPC01JnVw2gA-kWyWBTLU_Fi5CGnuvMvcpY-e_OtwHbb3IzhON_jI May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 844b7e02c0cd44ffa3716cd2380cca25 May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-VolumesNegativeTest-262757254 May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:53:17.151995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:53:17.153359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/844b7e02c0cd44ffa3716cd2380cca25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/844b7e02c0cd44ffa3716cd2380cca25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_844b7e02c0cd44ffa3716cd2380cca25", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/844b7e02c0cd44ffa3716cd2380cca25"}]}] May 26 16:53:17.153359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-VolumesNegativeTest-262757254 May 26 16:53:17.153359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 844b7e02c0cd44ffa3716cd2380cca25 May 26 16:53:17.153359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-VolumesNegativeTest-262757254 May 26 16:53:17.153359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-VolumesNegativeTest-262757254-project May 26 16:53:17.153359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:53:17.153359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:53:17.153359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 50b0c2f106e443d882ce8b13ebf6f50b May 26 16:53:17.153359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-VolumesNegativeTest-262757254-project May 26 16:53:17.153359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: May 26 16:53:17.153359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1664988002", "metadata": {"Type": "work"}}} May 26 16:53:17.153359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: May 26 16:53:17.153359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1664988002', 'metadata': {'Type': 'work'}}}} May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise error May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi '0' May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:53:17.154176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 16:53:17.155364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 16:53:17.156375 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 16:53:17.156375 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.157486 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9757cabd-56e1-4b20-99e2-494293db06ee tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:53:17.158592 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9757cabd-56e1-4b20-99e2-494293db06ee tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015451 May 26 16:53:17.160167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 2/2] 10.222.0.48 () {60 vars in 1155 bytes} [Thu May 26 16:53:17 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 26 16:53:17.171559 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8468afb9-f7b2-4582-92af-277b93eb3c7c tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Action: 'create', calling method: .version_select at 0x7fbe8237c0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1148032560", "metadata": {"Type": "work"}}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8468afb9-f7b2-4582-92af-277b93eb3c7c tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Request method failure captured: May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 119 May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7B7SSfURrpVo874WyPqSZYtOXIauOqC5dVSeK57QQMgt16fHrAvzY4Cq7cZgYAZQSpQuGWoQIjlSKrfXPVp2tKfa96fjg9TNR1M60zybuK7AXzunv_O_kKJbdZPC01JnVw2gA-kWyWBTLU_Fi5CGnuvMvcpY-e_OtwHbb3IzhON_jI May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 844b7e02c0cd44ffa3716cd2380cca25 May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-VolumesNegativeTest-262757254 May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:53:17.179107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:53:17.180491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/844b7e02c0cd44ffa3716cd2380cca25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/844b7e02c0cd44ffa3716cd2380cca25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_844b7e02c0cd44ffa3716cd2380cca25", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/844b7e02c0cd44ffa3716cd2380cca25"}]}] May 26 16:53:17.180491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-VolumesNegativeTest-262757254 May 26 16:53:17.180491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 844b7e02c0cd44ffa3716cd2380cca25 May 26 16:53:17.180491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-VolumesNegativeTest-262757254 May 26 16:53:17.180491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-VolumesNegativeTest-262757254-project May 26 16:53:17.180491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:53:17.180491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:53:17.180491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 50b0c2f106e443d882ce8b13ebf6f50b May 26 16:53:17.180491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-VolumesNegativeTest-262757254-project May 26 16:53:17.180491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: May 26 16:53:17.180491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1148032560", "metadata": {"Type": "work"}}} May 26 16:53:17.180491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: May 26 16:53:17.180491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1148032560', 'metadata': {'Type': 'work'}}}} May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise error May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi '' May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:53:17.181217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 16:53:17.182575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 16:53:17.183922 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 16:53:17.183922 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:17.184773 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8468afb9-f7b2-4582-92af-277b93eb3c7c tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:53:17.185991 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8468afb9-f7b2-4582-92af-277b93eb3c7c tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019465 May 26 16:53:17.186543 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 3/3] 10.222.0.48 () {60 vars in 1155 bytes} [Thu May 26 16:53:17 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 16:53:17.196089 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-354c4ccc-d168-4ac2-99f2-16d7f7ea0cc0 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Calling method '.version_select at 0x7fbe8233dca0>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:17.451643 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2024645415", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "networks": [{"uuid": "f8df8ce2-f92c-4683-9f6d-6dc77424bb8f"}]}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:18.120961 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] validate_networks() for [('f8df8ce2-f92c-4683-9f6d-6dc77424bb8f', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:53:18.188561 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-354c4ccc-d168-4ac2-99f2-16d7f7ea0cc0 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] HTTP exception thrown: Volume tempest-invalid-296139689 could not be found. May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-354c4ccc-d168-4ac2-99f2-16d7f7ea0cc0 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Request method failure captured: May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-296139689 HTTP/1.1 May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7B7SSfURrpVo874WyPqSZYtOXIauOqC5dVSeK57QQMgt16fHrAvzY4Cq7cZgYAZQSpQuGWoQIjlSKrfXPVp2tKfa96fjg9TNR1M60zybuK7AXzunv_O_kKJbdZPC01JnVw2gA-kWyWBTLU_Fi5CGnuvMvcpY-e_OtwHbb3IzhON_jI May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 844b7e02c0cd44ffa3716cd2380cca25 May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-VolumesNegativeTest-262757254 May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:53:18.194426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:53:18.195496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/844b7e02c0cd44ffa3716cd2380cca25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/844b7e02c0cd44ffa3716cd2380cca25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_844b7e02c0cd44ffa3716cd2380cca25", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/844b7e02c0cd44ffa3716cd2380cca25"}]}] May 26 16:53:18.195496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-VolumesNegativeTest-262757254 May 26 16:53:18.195496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 844b7e02c0cd44ffa3716cd2380cca25 May 26 16:53:18.195496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-VolumesNegativeTest-262757254 May 26 16:53:18.195496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-VolumesNegativeTest-262757254-project May 26 16:53:18.195496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:53:18.195496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:53:18.195496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 50b0c2f106e443d882ce8b13ebf6f50b May 26 16:53:18.195496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-VolumesNegativeTest-262757254-project May 26 16:53:18.195496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: May 26 16:53:18.195496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Volume tempest-invalid-296139689 could not be found. May 26 16:53:18.195496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': 'tempest-invalid-296139689'} May 26 16:53:18.195496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-296139689 could not be found. (HTTP 404) (Request-ID: req-cb14a3b8-ca38-463f-a98c-d6b809dbfea6) May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:18.196125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 16:53:18.197190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-296139689 could not be found. May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:53:18.198739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-296139689 could not be found. May 26 16:53:18.199667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.199667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:18.199667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.199667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:18.199667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:18.199667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:18.199667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:53:18.199667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:53:18.199667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-296139689 could not be found. May 26 16:53:18.199667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.203750 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-354c4ccc-d168-4ac2-99f2-16d7f7ea0cc0 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Returning 404 to user: Volume tempest-invalid-296139689 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:53:18.210554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-354c4ccc-d168-4ac2-99f2-16d7f7ea0cc0 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-296139689" status: 404 len: 98 microversion: 2.1 time: 1.013683 May 26 16:53:18.210554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 4/4] 10.222.0.48 () {58 vars in 1214 bytes} [Thu May 26 16:53:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-296139689 => generated 98 bytes in 1016 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 26 16:53:18.220511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-bfe37f40-cce5-4f48-8987-41fa5f0dc350 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008007 May 26 16:53:18.225182 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 5/5] 10.222.0.48 () {58 vars in 1139 bytes} [Thu May 26 16:53:18 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 16:53:18.232318 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4c4228aa-5658-47e2-802b-6bc7820306c8 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003788 May 26 16:53:18.237822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 6/6] 10.222.0.48 () {58 vars in 1136 bytes} [Thu May 26 16:53:18 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 16:53:18.243572 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-215b25bd-9e70-4827-8afd-b13dc7d1a108 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Calling method '.version_select at 0x7fbe822761f0>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:18.442338 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-215b25bd-9e70-4827-8afd-b13dc7d1a108 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] HTTP exception thrown: Volume dab419fd-4493-4459-bb6c-18561099a7e5 could not be found. May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-215b25bd-9e70-4827-8afd-b13dc7d1a108 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Request method failure captured: May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: DELETE /compute/v2.1/os-volumes/dab419fd-4493-4459-bb6c-18561099a7e5 HTTP/1.1 May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7B7SSfURrpVo874WyPqSZYtOXIauOqC5dVSeK57QQMgt16fHrAvzY4Cq7cZgYAZQSpQuGWoQIjlSKrfXPVp2tKfa96fjg9TNR1M60zybuK7AXzunv_O_kKJbdZPC01JnVw2gA-kWyWBTLU_Fi5CGnuvMvcpY-e_OtwHbb3IzhON_jI May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 844b7e02c0cd44ffa3716cd2380cca25 May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-VolumesNegativeTest-262757254 May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:53:18.444998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:53:18.446051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/844b7e02c0cd44ffa3716cd2380cca25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/844b7e02c0cd44ffa3716cd2380cca25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_844b7e02c0cd44ffa3716cd2380cca25", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/844b7e02c0cd44ffa3716cd2380cca25"}]}] May 26 16:53:18.446051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-VolumesNegativeTest-262757254 May 26 16:53:18.446051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 844b7e02c0cd44ffa3716cd2380cca25 May 26 16:53:18.446051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-VolumesNegativeTest-262757254 May 26 16:53:18.446051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-VolumesNegativeTest-262757254-project May 26 16:53:18.446051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:53:18.446051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:53:18.446051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 50b0c2f106e443d882ce8b13ebf6f50b May 26 16:53:18.446051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-VolumesNegativeTest-262757254-project May 26 16:53:18.446051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: May 26 16:53:18.446051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Volume dab419fd-4493-4459-bb6c-18561099a7e5 could not be found. May 26 16:53:18.446051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': 'dab419fd-4493-4459-bb6c-18561099a7e5'} May 26 16:53:18.446051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dab419fd-4493-4459-bb6c-18561099a7e5 could not be found. (HTTP 404) (Request-ID: req-8be03264-667a-4a26-8fa8-84f58b778628) May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:18.446644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 16:53:18.447511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dab419fd-4493-4459-bb6c-18561099a7e5 could not be found. May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 16:53:18.449162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:53:18.450306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dab419fd-4493-4459-bb6c-18561099a7e5 could not be found. May 26 16:53:18.450306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.450306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:18.450306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.450306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:18.450306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:18.450306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:18.450306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:53:18.450306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:53:18.450306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dab419fd-4493-4459-bb6c-18561099a7e5 could not be found. May 26 16:53:18.450306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.450306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-215b25bd-9e70-4827-8afd-b13dc7d1a108 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Returning 404 to user: Volume dab419fd-4493-4459-bb6c-18561099a7e5 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:53:18.450306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-215b25bd-9e70-4827-8afd-b13dc7d1a108 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/dab419fd-4493-4459-bb6c-18561099a7e5" status: 404 len: 109 microversion: 2.1 time: 0.207479 May 26 16:53:18.457626 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 7/7] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 26 16:53:18 2022] DELETE /compute/v2.1/os-volumes/dab419fd-4493-4459-bb6c-18561099a7e5 => generated 109 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:53:18.465003 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-acb26cf4-1a65-4009-8d2a-7a1558c86289 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Calling method '.version_select at 0x7fbe82276430>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:18.679738 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-acb26cf4-1a65-4009-8d2a-7a1558c86289 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] HTTP exception thrown: Volume 933f635a-caa0-4d5c-8193-408a530551fe could not be found. May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-acb26cf4-1a65-4009-8d2a-7a1558c86289 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Request method failure captured: May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/os-volumes/933f635a-caa0-4d5c-8193-408a530551fe HTTP/1.1 May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7B7SSfURrpVo874WyPqSZYtOXIauOqC5dVSeK57QQMgt16fHrAvzY4Cq7cZgYAZQSpQuGWoQIjlSKrfXPVp2tKfa96fjg9TNR1M60zybuK7AXzunv_O_kKJbdZPC01JnVw2gA-kWyWBTLU_Fi5CGnuvMvcpY-e_OtwHbb3IzhON_jI May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 844b7e02c0cd44ffa3716cd2380cca25 May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-VolumesNegativeTest-262757254 May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:53:18.682701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:53:18.695019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/844b7e02c0cd44ffa3716cd2380cca25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/844b7e02c0cd44ffa3716cd2380cca25"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_844b7e02c0cd44ffa3716cd2380cca25", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/844b7e02c0cd44ffa3716cd2380cca25"}]}] May 26 16:53:18.695019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-VolumesNegativeTest-262757254 May 26 16:53:18.695019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 844b7e02c0cd44ffa3716cd2380cca25 May 26 16:53:18.695019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-VolumesNegativeTest-262757254 May 26 16:53:18.695019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-VolumesNegativeTest-262757254-project May 26 16:53:18.695019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:53:18.695019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:53:18.695019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 50b0c2f106e443d882ce8b13ebf6f50b May 26 16:53:18.695019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-VolumesNegativeTest-262757254-project May 26 16:53:18.695019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: May 26 16:53:18.695019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Volume 933f635a-caa0-4d5c-8193-408a530551fe could not be found. May 26 16:53:18.695019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '933f635a-caa0-4d5c-8193-408a530551fe'} May 26 16:53:18.695019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 933f635a-caa0-4d5c-8193-408a530551fe could not be found. (HTTP 404) (Request-ID: req-e8f416f9-009d-4a20-beed-c99966c9d642) May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:18.695975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 16:53:18.697093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 933f635a-caa0-4d5c-8193-408a530551fe could not be found. May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 16:53:18.701663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:53:18.704309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 933f635a-caa0-4d5c-8193-408a530551fe could not be found. May 26 16:53:18.704309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.704309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:53:18.704309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.704309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:53:18.704309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:53:18.704309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:53:18.704309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:53:18.704309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:53:18.704309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 933f635a-caa0-4d5c-8193-408a530551fe could not be found. May 26 16:53:18.704309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:53:18.704309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-acb26cf4-1a65-4009-8d2a-7a1558c86289 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] Returning 404 to user: Volume 933f635a-caa0-4d5c-8193-408a530551fe could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:53:18.704309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-acb26cf4-1a65-4009-8d2a-7a1558c86289 tempest-VolumesNegativeTest-262757254 tempest-VolumesNegativeTest-262757254-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/933f635a-caa0-4d5c-8193-408a530551fe" status: 404 len: 109 microversion: 2.1 time: 0.225105 May 26 16:53:18.708938 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 8/8] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 26 16:53:18 2022] GET /compute/v2.1/os-volumes/933f635a-caa0-4d5c-8193-408a530551fe => generated 109 bytes in 250 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:53:20.058006 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:53:20.063150 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:53:20.063942 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:53:20.064487 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:53:20.065042 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:53:20.107633 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:20.108086 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:20.109834 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:20.110478 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:20.172343 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Getting quotas for project 187d77d887774bbc82b249a64f335d59. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:53:20.185326 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Getting quotas for user e17514d68a274a0dbe606bb8db60c747 and project 187d77d887774bbc82b249a64f335d59. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:53:20.199912 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:53:20.204810 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:53:20.424019 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-10ea82da-4d4d-4687-b4fa-a460d76720cf tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.236656 May 26 16:53:20.424662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 1/9] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 16:53:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 4239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 16:53:20.443545 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-263be5ce-5c73-410c-99ae-cd4fa90512da tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:20.445470 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-263be5ce-5c73-410c-99ae-cd4fa90512da tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:20.570937 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-263be5ce-5c73-410c-99ae-cd4fa90512da tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:20.601112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-263be5ce-5c73-410c-99ae-cd4fa90512da tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1215 microversion: 2.1 time: 0.163334 May 26 16:53:20.612045 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 9/10] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:20 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:21.619026 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3c6f6c95-d0cb-48c9-88ab-60387fde7a27 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:21.620185 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3c6f6c95-d0cb-48c9-88ab-60387fde7a27 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:22.004948 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3c6f6c95-d0cb-48c9-88ab-60387fde7a27 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:22.039034 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3c6f6c95-d0cb-48c9-88ab-60387fde7a27 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1215 microversion: 2.1 time: 0.422767 May 26 16:53:22.039642 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 2/11] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:21 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1215 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:23.056293 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-d5d27f2a-60f3-401e-a742-c4b96ea5aea2 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:23.057392 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-d5d27f2a-60f3-401e-a742-c4b96ea5aea2 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:23.199489 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d5d27f2a-60f3-401e-a742-c4b96ea5aea2 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:23.219773 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-d5d27f2a-60f3-401e-a742-c4b96ea5aea2 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1215 microversion: 2.1 time: 0.162387 May 26 16:53:23.220541 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 10/12] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:23 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1215 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:24.237750 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2fb7a96f-5faf-4d06-9a9e-16257d488f4e tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:24.239819 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2fb7a96f-5faf-4d06-9a9e-16257d488f4e tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:24.252538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2fb7a96f-5faf-4d06-9a9e-16257d488f4e tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:24.254225 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2fb7a96f-5faf-4d06-9a9e-16257d488f4e tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:24.261193 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2fb7a96f-5faf-4d06-9a9e-16257d488f4e tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:24.262032 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2fb7a96f-5faf-4d06-9a9e-16257d488f4e tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:24.668127 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2fb7a96f-5faf-4d06-9a9e-16257d488f4e tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:24.688237 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2fb7a96f-5faf-4d06-9a9e-16257d488f4e tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1219 microversion: 2.1 time: 0.454392 May 26 16:53:24.702305 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 3/13] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:24 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1219 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:25.708766 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a4106a49-bba8-4d7e-afc1-aa847be27048 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:25.710279 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a4106a49-bba8-4d7e-afc1-aa847be27048 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:25.720644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a4106a49-bba8-4d7e-afc1-aa847be27048 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:25.725735 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a4106a49-bba8-4d7e-afc1-aa847be27048 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:25.728297 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a4106a49-bba8-4d7e-afc1-aa847be27048 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:25.731941 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a4106a49-bba8-4d7e-afc1-aa847be27048 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:26.180122 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a4106a49-bba8-4d7e-afc1-aa847be27048 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:26.214070 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a4106a49-bba8-4d7e-afc1-aa847be27048 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1267 microversion: 2.1 time: 0.509616 May 26 16:53:26.215222 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 11/14] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:25 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1267 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:27.253312 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f4529535-d783-44ab-927c-764635578b51 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:27.253312 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f4529535-d783-44ab-927c-764635578b51 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:27.263672 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4529535-d783-44ab-927c-764635578b51 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:27.264182 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4529535-d783-44ab-927c-764635578b51 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:27.265122 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4529535-d783-44ab-927c-764635578b51 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:27.266861 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4529535-d783-44ab-927c-764635578b51 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:27.642544 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f4529535-d783-44ab-927c-764635578b51 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:27.659640 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f4529535-d783-44ab-927c-764635578b51 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1275 microversion: 2.1 time: 0.417852 May 26 16:53:27.661709 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 4/15] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:27 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1275 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:28.310400 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1660258644", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:28.562128 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.network.neutron [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] validate_networks() for [('b6174ed6-c511-43d9-b82c-ba126d400329', None, None, None, None, None)] {{(pid=124836) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:53:28.683281 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cb095b93-f85b-45c3-a005-42ffc0472826 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:28.685102 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cb095b93-f85b-45c3-a005-42ffc0472826 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:28.720033 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cb095b93-f85b-45c3-a005-42ffc0472826 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:28.732540 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cb095b93-f85b-45c3-a005-42ffc0472826 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:28.733170 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cb095b93-f85b-45c3-a005-42ffc0472826 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:28.736573 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cb095b93-f85b-45c3-a005-42ffc0472826 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:29.093684 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cb095b93-f85b-45c3-a005-42ffc0472826 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:29.119782 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cb095b93-f85b-45c3-a005-42ffc0472826 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1275 microversion: 2.1 time: 0.440652 May 26 16:53:29.120383 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 5/16] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:28 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1275 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:30.139607 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9e3d5aec-f1c7-43d5-8d08-ada49eda1a9c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:30.141086 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9e3d5aec-f1c7-43d5-8d08-ada49eda1a9c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:30.144249 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:30.155050 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9e3d5aec-f1c7-43d5-8d08-ada49eda1a9c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:30.158176 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9e3d5aec-f1c7-43d5-8d08-ada49eda1a9c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:30.160099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9e3d5aec-f1c7-43d5-8d08-ada49eda1a9c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:30.164680 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9e3d5aec-f1c7-43d5-8d08-ada49eda1a9c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:30.427122 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9e3d5aec-f1c7-43d5-8d08-ada49eda1a9c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:30.451405 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9e3d5aec-f1c7-43d5-8d08-ada49eda1a9c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1285 microversion: 2.1 time: 0.313449 May 26 16:53:30.452316 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 6/17] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:30 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1285 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:30.724766 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Flavor limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:53:30.725209 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Image limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:53:30.726701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Flavor pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:53:30.726701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Image pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:53:30.726701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:53:30.784585 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:30.785044 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:30.787286 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:30.787756 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:30.868206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Getting quotas for project 5150e5b054d34d09a3cb69e35f9c86dd. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:53:30.887156 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Getting quotas for user 1cf5ba73296e41c4ab58a6a962b578d3 and project 5150e5b054d34d09a3cb69e35f9c86dd. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:53:30.919261 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Going to run 1 instances... {{(pid=124836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:53:30.924961 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:53:31.266930 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-34d9255c-4610-453f-9663-20573d2eb7aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.286010 May 26 16:53:31.268082 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 12/18] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 16:53:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 3288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 16:53:31.281619 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9a56cb9b-baf6-43da-9e98-e19191497548 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:31.282431 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9a56cb9b-baf6-43da-9e98-e19191497548 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:31.472460 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-28b4446e-e9b5-4ae7-90fd-2ce5fc5186ca tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:31.475176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-28b4446e-e9b5-4ae7-90fd-2ce5fc5186ca tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:31.495377 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-28b4446e-e9b5-4ae7-90fd-2ce5fc5186ca tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:31.496263 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-28b4446e-e9b5-4ae7-90fd-2ce5fc5186ca tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:31.499149 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-28b4446e-e9b5-4ae7-90fd-2ce5fc5186ca tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:31.506318 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-28b4446e-e9b5-4ae7-90fd-2ce5fc5186ca tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:31.747649 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9a56cb9b-baf6-43da-9e98-e19191497548 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:31.773474 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9a56cb9b-baf6-43da-9e98-e19191497548 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1222 microversion: 2.1 time: 0.489959 May 26 16:53:31.786616 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 7/19] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:31 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1222 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:31.839840 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-28b4446e-e9b5-4ae7-90fd-2ce5fc5186ca tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:31.853214 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-28b4446e-e9b5-4ae7-90fd-2ce5fc5186ca tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1273 microversion: 2.1 time: 0.387876 May 26 16:53:31.862013 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 13/20] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:31 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1273 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:53:32.271562 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2021776107", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:32.427356 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] validate_networks() for [('b6174ed6-c511-43d9-b82c-ba126d400329', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:53:32.985710 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-d976babe-fd79-4172-a7c1-b986631e0cc8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Action: 'create', calling method: .version_select at 0x7fbe820ce4c0>, body: {"keypair": {"name": "tempest-keypair-955371537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/1LCCw1KC+YSlppjVr0O1InduMBpvnOdBqtYmsdSpsZtSxn2cObzfhlRraRvJbcWYLQ0iV7O24J1xHLDJc19mO0A+wqgrZGBWPUacoX7DHY5/F/08jxIDiUZZ0wvmqyg=="}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:33.138061 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-d976babe-fd79-4172-a7c1-b986631e0cc8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Getting quotas for project 89a7299f01984027a505aa43d96e07b3. Resources: {'key_pairs'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:53:33.157527 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-d976babe-fd79-4172-a7c1-b986631e0cc8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Getting quotas for user d5684eb0dd3141f5a25b61aafedbe865 and project 89a7299f01984027a505aa43d96e07b3. Resources: {'key_pairs'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:53:33.499073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-d976babe-fd79-4172-a7c1-b986631e0cc8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.962769 May 26 16:53:33.500286 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 14/21] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 26 16:53:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:53:33.667654 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-36dc02a9-88b7-4961-91d3-f49506e5d0ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:33.667654 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-36dc02a9-88b7-4961-91d3-f49506e5d0ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:33.667654 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-36dc02a9-88b7-4961-91d3-f49506e5d0ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:33.667654 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-36dc02a9-88b7-4961-91d3-f49506e5d0ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:33.670161 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-36dc02a9-88b7-4961-91d3-f49506e5d0ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:33.670161 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-36dc02a9-88b7-4961-91d3-f49506e5d0ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:34.303793 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:53:34.304466 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:53:34.305448 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:53:34.306599 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:53:34.307584 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:53:34.332505 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:34.339202 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:34.340709 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:34.343748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:34.401656 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Getting quotas for project 5150e5b054d34d09a3cb69e35f9c86dd. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:53:34.417234 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Getting quotas for user 1cf5ba73296e41c4ab58a6a962b578d3 and project 5150e5b054d34d09a3cb69e35f9c86dd. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:53:34.458396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:53:34.461751 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:53:34.664668 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ac968ef8-3d81-41c8-aabb-298603dbb595 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.399474 May 26 16:53:34.681465 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 8/22] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 16:53:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 16:53:34.742363 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-36dc02a9-88b7-4961-91d3-f49506e5d0ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:34.761708 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-36dc02a9-88b7-4961-91d3-f49506e5d0ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 1.256135 May 26 16:53:34.762352 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 15/23] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:33 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:34.784516 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6564ed06-f86d-4140-a000-e9f96f3cde25 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:34.808445 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6564ed06-f86d-4140-a000-e9f96f3cde25 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:34.865679 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fcb9a319-df6b-4672-8f1c-a6199b7bcd31 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Action: 'create', calling method: .version_select at 0x7fbe81186f70>, body: {"keypair": {"name": "tempest-keypair-1783983421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1SeVypS6vvfBW9iO3nyI2GsbsEmm3MKzY32G9IUqaB75oT2gGj5COfkz29XxluHc+JVBA9GiITlsV6HiM/7cHtpvPJh//jzeudwjrVEFdUk1SPl7dpFybmN13pzTMFgQ=="}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:34.918207 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-fcb9a319-df6b-4672-8f1c-a6199b7bcd31 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Getting quotas for project 5a16c7d70bb14cd3b898751084649cd2. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:53:34.931077 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-fcb9a319-df6b-4672-8f1c-a6199b7bcd31 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Getting quotas for user 89f20368c3a747a49a3aaa556115d169 and project 5a16c7d70bb14cd3b898751084649cd2. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:53:35.186880 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6564ed06-f86d-4140-a000-e9f96f3cde25 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:35.194331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6564ed06-f86d-4140-a000-e9f96f3cde25 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1222 microversion: 2.1 time: 0.427418 May 26 16:53:35.210345 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 16/24] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:34 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1222 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:35.252471 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fcb9a319-df6b-4672-8f1c-a6199b7bcd31 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.563141 May 26 16:53:35.264317 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 9/25] 10.222.0.48 () {62 vars in 1199 bytes} [Thu May 26 16:53:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 582 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 16:53:35.781768 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-57e9d713-adac-4648-a25b-e08d5caf6a4c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:35.781768 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-57e9d713-adac-4648-a25b-e08d5caf6a4c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:35.794574 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-57e9d713-adac-4648-a25b-e08d5caf6a4c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:35.801680 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-57e9d713-adac-4648-a25b-e08d5caf6a4c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:35.808572 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-57e9d713-adac-4648-a25b-e08d5caf6a4c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:35.816308 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-57e9d713-adac-4648-a25b-e08d5caf6a4c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:36.212107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e702c183-a7fa-4e8e-91a8-a72b610aa8b6 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:36.212798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e702c183-a7fa-4e8e-91a8-a72b610aa8b6 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:36.279548 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-57e9d713-adac-4648-a25b-e08d5caf6a4c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:36.291242 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-57e9d713-adac-4648-a25b-e08d5caf6a4c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.516414 May 26 16:53:36.294490 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 17/26] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:35 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:36.435039 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e702c183-a7fa-4e8e-91a8-a72b610aa8b6 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:36.452979 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e702c183-a7fa-4e8e-91a8-a72b610aa8b6 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1222 microversion: 2.1 time: 0.244850 May 26 16:53:36.469817 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 10/27] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:36 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1222 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:53:37.051147 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-8f409e08-064e-4ed1-8d56-4fabfd64f6bb req-19c89812-0abb-421f-b34b-36fea7b738c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd6396b4-ab96-4ef1-86da-ced71936a336", "tag": "461bedf8-343c-4769-a3de-3519954e0aa0"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:37.099814 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-8f409e08-064e-4ed1-8d56-4fabfd64f6bb req-19c89812-0abb-421f-b34b-36fea7b738c6 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:37.100371 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-8f409e08-064e-4ed1-8d56-4fabfd64f6bb req-19c89812-0abb-421f-b34b-36fea7b738c6 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:37.151452 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-8f409e08-064e-4ed1-8d56-4fabfd64f6bb req-19c89812-0abb-421f-b34b-36fea7b738c6 service nova] Creating event network-changed:461bedf8-343c-4769-a3de-3519954e0aa0 for instance dd6396b4-ab96-4ef1-86da-ced71936a336 on hv-cinder-83607 May 26 16:53:37.151719 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-8f409e08-064e-4ed1-8d56-4fabfd64f6bb req-19c89812-0abb-421f-b34b-36fea7b738c6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124836) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 16:53:37.152878 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-978391af-365d-4152-af00-4c45f51a3823 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:37.153355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-978391af-365d-4152-af00-4c45f51a3823 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:37.156151 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-978391af-365d-4152-af00-4c45f51a3823 None None] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:37.156608 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-978391af-365d-4152-af00-4c45f51a3823 None None] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:37.183331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.compute.rpcapi [None req-978391af-365d-4152-af00-4c45f51a3823 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 16:53:37.184249 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-978391af-365d-4152-af00-4c45f51a3823 None None] Releasing lock "compute-rpcapi-router" {{(pid=124836) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 16:53:37.240133 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-978391af-365d-4152-af00-4c45f51a3823 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.274999 May 26 16:53:37.240991 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 18/28] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:53:37.311942 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-89dd1436-4d78-4805-9ab6-d5cc4b1ad848 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:37.313372 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-89dd1436-4d78-4805-9ab6-d5cc4b1ad848 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:37.326457 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-89dd1436-4d78-4805-9ab6-d5cc4b1ad848 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:37.327136 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-89dd1436-4d78-4805-9ab6-d5cc4b1ad848 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:37.328154 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-89dd1436-4d78-4805-9ab6-d5cc4b1ad848 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:37.328867 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-89dd1436-4d78-4805-9ab6-d5cc4b1ad848 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:37.476704 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-60473b1d-4234-4aed-9ec7-3c29fafe572a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:37.477720 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-60473b1d-4234-4aed-9ec7-3c29fafe572a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:37.499061 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-60473b1d-4234-4aed-9ec7-3c29fafe572a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:37.501213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-60473b1d-4234-4aed-9ec7-3c29fafe572a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:37.502295 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-60473b1d-4234-4aed-9ec7-3c29fafe572a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:37.511710 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-60473b1d-4234-4aed-9ec7-3c29fafe572a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:37.640220 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-60473b1d-4234-4aed-9ec7-3c29fafe572a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:37.643391 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-89dd1436-4d78-4805-9ab6-d5cc4b1ad848 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:37.657216 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-89dd1436-4d78-4805-9ab6-d5cc4b1ad848 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.350301 May 26 16:53:37.657688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-60473b1d-4234-4aed-9ec7-3c29fafe572a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1226 microversion: 2.1 time: 0.185083 May 26 16:53:37.657836 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 11/29] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:37 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:37.661440 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 19/30] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:37 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1226 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:53:38.679737 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1bddb7b3-8180-4132-97cc-be8f0139e28e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:38.682618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-270dc178-23d9-4a2a-a957-85ad1c6ed632 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:38.684636 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1bddb7b3-8180-4132-97cc-be8f0139e28e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:38.689188 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-270dc178-23d9-4a2a-a957-85ad1c6ed632 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:38.704066 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1bddb7b3-8180-4132-97cc-be8f0139e28e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:38.706059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1bddb7b3-8180-4132-97cc-be8f0139e28e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:38.706812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-270dc178-23d9-4a2a-a957-85ad1c6ed632 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:38.708455 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-270dc178-23d9-4a2a-a957-85ad1c6ed632 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:38.708692 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1bddb7b3-8180-4132-97cc-be8f0139e28e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:38.709216 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1bddb7b3-8180-4132-97cc-be8f0139e28e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:38.710154 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-270dc178-23d9-4a2a-a957-85ad1c6ed632 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:38.715572 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-270dc178-23d9-4a2a-a957-85ad1c6ed632 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:38.853693 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1bddb7b3-8180-4132-97cc-be8f0139e28e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:38.891927 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1bddb7b3-8180-4132-97cc-be8f0139e28e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1226 microversion: 2.1 time: 0.219504 May 26 16:53:38.894931 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 12/31] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:38 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1226 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:39.237588 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-425292047", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37da0019-c0ef-4a38-bc4c-338c9bba0a61"}], "security_groups": [{"name": "tempest-securitygroup--395112333"}], "key_name": "tempest-keypair-955371537", "user_data": "}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:40.129657 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] validate_networks() for [('37da0019-c0ef-4a38-bc4c-338c9bba0a61', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:53:40.226135 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-270dc178-23d9-4a2a-a957-85ad1c6ed632 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:40.238712 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-270dc178-23d9-4a2a-a957-85ad1c6ed632 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 1.568293 May 26 16:53:40.255136 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 20/32] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:38 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:40.283002 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-d1484c26-8b4a-4189-9ee7-3a3391b47d1a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:40.284230 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-d1484c26-8b4a-4189-9ee7-3a3391b47d1a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:40.301215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d1484c26-8b4a-4189-9ee7-3a3391b47d1a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:40.302502 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d1484c26-8b4a-4189-9ee7-3a3391b47d1a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:40.303518 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d1484c26-8b4a-4189-9ee7-3a3391b47d1a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:40.304165 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d1484c26-8b4a-4189-9ee7-3a3391b47d1a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:40.415794 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d1484c26-8b4a-4189-9ee7-3a3391b47d1a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:40.439039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-d1484c26-8b4a-4189-9ee7-3a3391b47d1a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1274 microversion: 2.1 time: 0.182290 May 26 16:53:40.440021 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 21/33] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:40 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1274 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:41.185140 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-162483403", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b6693f4-44e6-4850-bb10-714588f8b298"}], "security_groups": [{"name": "tempest-securitygroup--876904954"}], "key_name": "tempest-keypair-1783983421", "user_data": "}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:41.439200 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:53:41.449352 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:53:41.450298 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:53:41.450871 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:53:41.451452 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:53:41.483295 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:41.483743 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:41.484565 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:41.484987 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:41.543485 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Getting quotas for project 89a7299f01984027a505aa43d96e07b3. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:53:41.552781 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Getting quotas for user d5684eb0dd3141f5a25b61aafedbe865 and project 89a7299f01984027a505aa43d96e07b3. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:53:41.588949 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:53:41.594583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:53:41.820428 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.network.neutron [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] validate_networks() for [('8b6693f4-44e6-4850-bb10-714588f8b298', None, None, None, None, None)] {{(pid=124836) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:53:41.962281 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3aae85a2-fb15-4220-9b8d-48248bc07e71 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.735770 May 26 16:53:41.966588 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 13/34] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 16:53:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 2740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 16:53:41.982058 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ce0e876f-cf7f-46a6-a6c5-c7f356417f3c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:41.984297 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ce0e876f-cf7f-46a6-a6c5-c7f356417f3c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:42.003209 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ce0e876f-cf7f-46a6-a6c5-c7f356417f3c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:42.007949 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ce0e876f-cf7f-46a6-a6c5-c7f356417f3c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:42.007949 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ce0e876f-cf7f-46a6-a6c5-c7f356417f3c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:42.007949 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ce0e876f-cf7f-46a6-a6c5-c7f356417f3c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:42.924058 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ce0e876f-cf7f-46a6-a6c5-c7f356417f3c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:42.936775 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ce0e876f-cf7f-46a6-a6c5-c7f356417f3c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.966597 May 26 16:53:42.939716 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 14/35] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:41 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:42.954854 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-655f38b3-51e6-451b-a8a1-f1be2f658b5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:42.957933 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-655f38b3-51e6-451b-a8a1-f1be2f658b5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:42.981897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-655f38b3-51e6-451b-a8a1-f1be2f658b5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:42.982412 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-655f38b3-51e6-451b-a8a1-f1be2f658b5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:42.985460 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-655f38b3-51e6-451b-a8a1-f1be2f658b5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:42.985960 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-655f38b3-51e6-451b-a8a1-f1be2f658b5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:43.205749 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-655f38b3-51e6-451b-a8a1-f1be2f658b5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:43.233640 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-655f38b3-51e6-451b-a8a1-f1be2f658b5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1280 microversion: 2.1 time: 0.291347 May 26 16:53:43.248243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 15/36] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:42 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1280 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:43.272573 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d8b0615a-3c17-42fa-a8d5-d360816a6e02 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:43.272573 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d8b0615a-3c17-42fa-a8d5-d360816a6e02 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:43.716305 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d8b0615a-3c17-42fa-a8d5-d360816a6e02 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:43.729066 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d8b0615a-3c17-42fa-a8d5-d360816a6e02 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1236 microversion: 2.1 time: 0.479405 May 26 16:53:43.739013 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 16/37] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:43 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1236 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:43.891794 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Flavor limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:53:43.891794 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Image limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:53:43.892693 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Flavor pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:53:43.896540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Image pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:53:43.898689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:53:43.909330 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:43.910163 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:43.911974 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:43.912742 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:43.937435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Getting quotas for project 5a16c7d70bb14cd3b898751084649cd2. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:53:43.948137 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Getting quotas for user 89f20368c3a747a49a3aaa556115d169 and project 5a16c7d70bb14cd3b898751084649cd2. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:53:43.958070 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-28ebfa63-0149-4aec-ba97-067238009c83 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:43.963329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-28ebfa63-0149-4aec-ba97-067238009c83 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:43.974123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-28ebfa63-0149-4aec-ba97-067238009c83 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:43.974907 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-28ebfa63-0149-4aec-ba97-067238009c83 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:43.980530 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-28ebfa63-0149-4aec-ba97-067238009c83 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:43.980530 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-28ebfa63-0149-4aec-ba97-067238009c83 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:43.987002 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Going to run 1 instances... {{(pid=124836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:53:43.992280 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:53:44.208181 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-1c65a2b5-b4ec-4b04-a4cb-8f1cc09d9ef0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.033499 May 26 16:53:44.216233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 22/38] 10.222.0.48 () {62 vars in 1187 bytes} [Thu May 26 16:53:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 3040 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 16:53:44.227497 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a06be76d-a599-4a6c-88be-ba080cc4110f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:44.230602 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a06be76d-a599-4a6c-88be-ba080cc4110f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:44.591824 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-28ebfa63-0149-4aec-ba97-067238009c83 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:44.633824 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-28ebfa63-0149-4aec-ba97-067238009c83 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.679583 May 26 16:53:44.637151 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 17/39] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:43 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:44.665227 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cffdbaf6-8122-4f61-a46f-9a358c8b3561 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:44.668000 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cffdbaf6-8122-4f61-a46f-9a358c8b3561 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:44.698897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cffdbaf6-8122-4f61-a46f-9a358c8b3561 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:44.720941 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cffdbaf6-8122-4f61-a46f-9a358c8b3561 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:44.722200 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cffdbaf6-8122-4f61-a46f-9a358c8b3561 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:44.722649 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cffdbaf6-8122-4f61-a46f-9a358c8b3561 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:44.840972 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a06be76d-a599-4a6c-88be-ba080cc4110f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:44.852787 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a06be76d-a599-4a6c-88be-ba080cc4110f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:44.861136 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a06be76d-a599-4a6c-88be-ba080cc4110f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:44.865134 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a06be76d-a599-4a6c-88be-ba080cc4110f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1281 microversion: 2.20 time: 0.647191 May 26 16:53:44.877300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 23/40] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:53:44 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1281 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:53:44.882308 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-93aef864-1f25-47f2-9682-33d0f4b9af07 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:44.882952 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-93aef864-1f25-47f2-9682-33d0f4b9af07 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:44.912610 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-93aef864-1f25-47f2-9682-33d0f4b9af07 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:44.915770 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-93aef864-1f25-47f2-9682-33d0f4b9af07 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:44.918326 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-93aef864-1f25-47f2-9682-33d0f4b9af07 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:44.919049 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-93aef864-1f25-47f2-9682-33d0f4b9af07 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:45.059976 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cffdbaf6-8122-4f61-a46f-9a358c8b3561 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:45.074753 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cffdbaf6-8122-4f61-a46f-9a358c8b3561 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1280 microversion: 2.1 time: 0.432701 May 26 16:53:45.085670 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 18/41] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:44 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1280 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:45.126315 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-93aef864-1f25-47f2-9682-33d0f4b9af07 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:45.151208 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-93aef864-1f25-47f2-9682-33d0f4b9af07 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1232 microversion: 2.1 time: 0.282721 May 26 16:53:45.161466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 24/42] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:44 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1232 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:45.652602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e4635479-0ee6-476c-a190-ef6cbd3f137f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:45.653442 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e4635479-0ee6-476c-a190-ef6cbd3f137f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:45.656732 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:45.663390 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4635479-0ee6-476c-a190-ef6cbd3f137f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:45.671540 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4635479-0ee6-476c-a190-ef6cbd3f137f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:45.671540 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4635479-0ee6-476c-a190-ef6cbd3f137f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:45.671540 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4635479-0ee6-476c-a190-ef6cbd3f137f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:45.890823 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2f5a6123-6463-4598-ba1e-359845d1cc7a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:45.891699 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2f5a6123-6463-4598-ba1e-359845d1cc7a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:46.118561 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2f5a6123-6463-4598-ba1e-359845d1cc7a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:46.121757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=25 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:46.146813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2f5a6123-6463-4598-ba1e-359845d1cc7a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:46.162381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2f5a6123-6463-4598-ba1e-359845d1cc7a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:46.169554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2f5a6123-6463-4598-ba1e-359845d1cc7a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1281 microversion: 2.20 time: 0.284649 May 26 16:53:46.184154 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 25/43] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:53:45 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1281 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:53:46.196277 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2dab947a-1d86-4eb7-8b3d-d0d228b9e353 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:46.197299 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2dab947a-1d86-4eb7-8b3d-d0d228b9e353 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:46.212338 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:46.215449 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2dab947a-1d86-4eb7-8b3d-d0d228b9e353 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:46.216263 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2dab947a-1d86-4eb7-8b3d-d0d228b9e353 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:46.217248 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2dab947a-1d86-4eb7-8b3d-d0d228b9e353 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:46.217937 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2dab947a-1d86-4eb7-8b3d-d0d228b9e353 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:46.272084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=57 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:46.436570 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e4635479-0ee6-476c-a190-ef6cbd3f137f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:46.449305 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e4635479-0ee6-476c-a190-ef6cbd3f137f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.796934 May 26 16:53:46.458233 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 19/44] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:45 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:46.459715 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-187813c9-78bf-41ef-ad58-2c3a63ff44f5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:46.460354 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-187813c9-78bf-41ef-ad58-2c3a63ff44f5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:46.481030 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-187813c9-78bf-41ef-ad58-2c3a63ff44f5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:46.481550 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-187813c9-78bf-41ef-ad58-2c3a63ff44f5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:46.482414 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-187813c9-78bf-41ef-ad58-2c3a63ff44f5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:46.482867 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-187813c9-78bf-41ef-ad58-2c3a63ff44f5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:46.713927 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-187813c9-78bf-41ef-ad58-2c3a63ff44f5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:46.726132 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=77 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:46.742068 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-187813c9-78bf-41ef-ad58-2c3a63ff44f5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1288 microversion: 2.1 time: 0.290311 May 26 16:53:46.758561 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 20/45] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:46 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1288 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:46.821508 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2dab947a-1d86-4eb7-8b3d-d0d228b9e353 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:46.839690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2dab947a-1d86-4eb7-8b3d-d0d228b9e353 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1322 microversion: 2.1 time: 0.647610 May 26 16:53:46.843989 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 26/46] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:46 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1322 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:47.194766 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4b588b6d-c0f0-43fb-94cb-96c9ec97d73c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:47.195740 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4b588b6d-c0f0-43fb-94cb-96c9ec97d73c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:47.215711 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4b588b6d-c0f0-43fb-94cb-96c9ec97d73c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:47.217873 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4b588b6d-c0f0-43fb-94cb-96c9ec97d73c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:47.221044 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4b588b6d-c0f0-43fb-94cb-96c9ec97d73c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:47.221639 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4b588b6d-c0f0-43fb-94cb-96c9ec97d73c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:47.334191 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4b588b6d-c0f0-43fb-94cb-96c9ec97d73c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:47.346710 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4b588b6d-c0f0-43fb-94cb-96c9ec97d73c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:47.355448 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4b588b6d-c0f0-43fb-94cb-96c9ec97d73c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:47.358468 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4b588b6d-c0f0-43fb-94cb-96c9ec97d73c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1285 microversion: 2.20 time: 0.170472 May 26 16:53:47.361515 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 21/47] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:53:47 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:53:47.485856 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-cb9780c5-0cf7-4809-abb5-058c19ab1057 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:47.487288 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-cb9780c5-0cf7-4809-abb5-058c19ab1057 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:47.505896 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cb9780c5-0cf7-4809-abb5-058c19ab1057 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:47.509912 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cb9780c5-0cf7-4809-abb5-058c19ab1057 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:47.516268 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cb9780c5-0cf7-4809-abb5-058c19ab1057 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:47.517534 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cb9780c5-0cf7-4809-abb5-058c19ab1057 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:47.762686 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fdcce84e-c250-4013-b6cc-7acf529b2a3e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:47.764233 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fdcce84e-c250-4013-b6cc-7acf529b2a3e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:47.773348 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fdcce84e-c250-4013-b6cc-7acf529b2a3e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:47.781939 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fdcce84e-c250-4013-b6cc-7acf529b2a3e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:47.783002 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fdcce84e-c250-4013-b6cc-7acf529b2a3e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:47.783599 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fdcce84e-c250-4013-b6cc-7acf529b2a3e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:47.956092 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-fdcce84e-c250-4013-b6cc-7acf529b2a3e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:47.972787 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-cb9780c5-0cf7-4809-abb5-058c19ab1057 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:47.980622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fdcce84e-c250-4013-b6cc-7acf529b2a3e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1296 microversion: 2.1 time: 0.221718 May 26 16:53:47.987832 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 22/48] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:47 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1296 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:53:47.989016 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-cb9780c5-0cf7-4809-abb5-058c19ab1057 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.522881 May 26 16:53:47.990029 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 27/49] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:47 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:48.029323 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b77d99a3-3d04-4e35-92b0-cbc3672be711 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:48.031071 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b77d99a3-3d04-4e35-92b0-cbc3672be711 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:48.060026 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b77d99a3-3d04-4e35-92b0-cbc3672be711 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:48.060504 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b77d99a3-3d04-4e35-92b0-cbc3672be711 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:48.063383 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b77d99a3-3d04-4e35-92b0-cbc3672be711 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:48.066907 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b77d99a3-3d04-4e35-92b0-cbc3672be711 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:48.153978 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-6861c284-c612-444b-8595-c6c6d2cd9e12 req-6ddfd292-af41-4798-bed7-7bccd3f669e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ecc34c3-8a11-43df-b56d-0996916a0187", "tag": "50fe6234-052f-41cc-8a4f-a24813700c3e"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:48.181026 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-6861c284-c612-444b-8595-c6c6d2cd9e12 req-6ddfd292-af41-4798-bed7-7bccd3f669e7 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:48.185131 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-6861c284-c612-444b-8595-c6c6d2cd9e12 req-6ddfd292-af41-4798-bed7-7bccd3f669e7 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:48.209934 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-6861c284-c612-444b-8595-c6c6d2cd9e12 req-6ddfd292-af41-4798-bed7-7bccd3f669e7 service nova] Creating event network-changed:50fe6234-052f-41cc-8a4f-a24813700c3e for instance 3ecc34c3-8a11-43df-b56d-0996916a0187 on hv-cinder-83607 May 26 16:53:48.216540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-6861c284-c612-444b-8595-c6c6d2cd9e12 req-6ddfd292-af41-4798-bed7-7bccd3f669e7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221610 May 26 16:53:48.217791 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 28/50] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:53:48.392394 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-83b8cf8a-8dea-40f3-bd89-401165bbdf34 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:48.393897 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-83b8cf8a-8dea-40f3-bd89-401165bbdf34 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:48.414723 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-83b8cf8a-8dea-40f3-bd89-401165bbdf34 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:48.415726 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-83b8cf8a-8dea-40f3-bd89-401165bbdf34 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:48.417307 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-83b8cf8a-8dea-40f3-bd89-401165bbdf34 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:48.423535 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-83b8cf8a-8dea-40f3-bd89-401165bbdf34 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:48.578563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-83b8cf8a-8dea-40f3-bd89-401165bbdf34 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:48.586143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b77d99a3-3d04-4e35-92b0-cbc3672be711 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:48.652429 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-83b8cf8a-8dea-40f3-bd89-401165bbdf34 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:48.652764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b77d99a3-3d04-4e35-92b0-cbc3672be711 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1322 microversion: 2.1 time: 0.612836 May 26 16:53:48.652764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 23/51] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:47 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1322 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:48.652903 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-83b8cf8a-8dea-40f3-bd89-401165bbdf34 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:48.652903 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-83b8cf8a-8dea-40f3-bd89-401165bbdf34 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1333 microversion: 2.20 time: 0.230618 May 26 16:53:48.652903 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 29/52] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:53:48 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1333 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:53:49.007279 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-66699a09-4e7b-4485-925a-f749b5327515 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:49.008071 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-66699a09-4e7b-4485-925a-f749b5327515 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:49.014986 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cc823acd-a7cd-43fa-9299-ad6ae0f104db tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:49.017029 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cc823acd-a7cd-43fa-9299-ad6ae0f104db tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:49.023296 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-66699a09-4e7b-4485-925a-f749b5327515 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:49.023742 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-66699a09-4e7b-4485-925a-f749b5327515 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:49.024702 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-66699a09-4e7b-4485-925a-f749b5327515 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:49.026985 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-66699a09-4e7b-4485-925a-f749b5327515 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:49.031239 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc823acd-a7cd-43fa-9299-ad6ae0f104db tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:49.031866 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc823acd-a7cd-43fa-9299-ad6ae0f104db tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:49.033289 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc823acd-a7cd-43fa-9299-ad6ae0f104db tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:49.034253 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc823acd-a7cd-43fa-9299-ad6ae0f104db tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:49.179617 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cc823acd-a7cd-43fa-9299-ad6ae0f104db tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:49.190261 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cc823acd-a7cd-43fa-9299-ad6ae0f104db tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1294 microversion: 2.1 time: 0.187659 May 26 16:53:49.191531 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 24/53] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:49 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1294 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:49.286819 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-66699a09-4e7b-4485-925a-f749b5327515 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:49.297223 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-66699a09-4e7b-4485-925a-f749b5327515 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.294485 May 26 16:53:49.297937 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 30/54] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:49 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:49.665533 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-66412f3d-bcd9-4ff3-b7e6-e6ddeb8bb46f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:49.666442 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-66412f3d-bcd9-4ff3-b7e6-e6ddeb8bb46f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:49.668013 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7cdfd50c-0da3-45f7-927f-586c36707739 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:49.668739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7cdfd50c-0da3-45f7-927f-586c36707739 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:49.678520 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7cdfd50c-0da3-45f7-927f-586c36707739 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:49.679266 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7cdfd50c-0da3-45f7-927f-586c36707739 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:49.680642 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7cdfd50c-0da3-45f7-927f-586c36707739 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:49.681412 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7cdfd50c-0da3-45f7-927f-586c36707739 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:49.682123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-66412f3d-bcd9-4ff3-b7e6-e6ddeb8bb46f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:49.682835 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-66412f3d-bcd9-4ff3-b7e6-e6ddeb8bb46f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:49.684464 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-66412f3d-bcd9-4ff3-b7e6-e6ddeb8bb46f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:49.686478 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-66412f3d-bcd9-4ff3-b7e6-e6ddeb8bb46f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:49.771573 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7cdfd50c-0da3-45f7-927f-586c36707739 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:49.782070 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7cdfd50c-0da3-45f7-927f-586c36707739 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:49.784026 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7cdfd50c-0da3-45f7-927f-586c36707739 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:49.785211 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7cdfd50c-0da3-45f7-927f-586c36707739 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1333 microversion: 2.20 time: 0.127212 May 26 16:53:49.797137 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 31/55] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:53:49 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1333 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:53:49.866884 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-66412f3d-bcd9-4ff3-b7e6-e6ddeb8bb46f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:49.875437 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-66412f3d-bcd9-4ff3-b7e6-e6ddeb8bb46f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1322 microversion: 2.1 time: 0.218047 May 26 16:53:49.876029 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 25/56] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:49 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:50.208119 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-d8686831-e35b-4dcf-8357-378b7d890fa8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:50.208874 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-d8686831-e35b-4dcf-8357-378b7d890fa8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:50.215398 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d8686831-e35b-4dcf-8357-378b7d890fa8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:50.216087 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d8686831-e35b-4dcf-8357-378b7d890fa8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:50.216865 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d8686831-e35b-4dcf-8357-378b7d890fa8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:50.217687 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d8686831-e35b-4dcf-8357-378b7d890fa8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:50.302615 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d8686831-e35b-4dcf-8357-378b7d890fa8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:50.314813 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bcfb5b4e-04f1-4d4c-9a89-1ad7a2b01ace tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:50.315534 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bcfb5b4e-04f1-4d4c-9a89-1ad7a2b01ace tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:50.325537 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-d8686831-e35b-4dcf-8357-378b7d890fa8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1294 microversion: 2.1 time: 0.121168 May 26 16:53:50.326556 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 32/57] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:50 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1294 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:50.329414 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bcfb5b4e-04f1-4d4c-9a89-1ad7a2b01ace tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:50.331425 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bcfb5b4e-04f1-4d4c-9a89-1ad7a2b01ace tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:50.333233 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bcfb5b4e-04f1-4d4c-9a89-1ad7a2b01ace tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:50.334988 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bcfb5b4e-04f1-4d4c-9a89-1ad7a2b01ace tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:50.505226 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-b299aa5f-d965-4f4d-85bf-426c3d038aca req-db1179dc-1cec-4261-8bc0-5588c42ce291 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81ee3901-edb0-46c8-9b68-5792f690cf5d", "tag": "875fe38c-8738-43ba-96e1-889e5291698c"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:50.524552 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-b299aa5f-d965-4f4d-85bf-426c3d038aca req-db1179dc-1cec-4261-8bc0-5588c42ce291 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:50.527843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-b299aa5f-d965-4f4d-85bf-426c3d038aca req-db1179dc-1cec-4261-8bc0-5588c42ce291 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:50.566215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-b299aa5f-d965-4f4d-85bf-426c3d038aca req-db1179dc-1cec-4261-8bc0-5588c42ce291 service nova] Creating event network-changed:875fe38c-8738-43ba-96e1-889e5291698c for instance 81ee3901-edb0-46c8-9b68-5792f690cf5d on hv-cinder-83607 May 26 16:53:50.579788 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-b299aa5f-d965-4f4d-85bf-426c3d038aca req-db1179dc-1cec-4261-8bc0-5588c42ce291 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081918 May 26 16:53:50.580417 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 33/58] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:53:50.684668 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bcfb5b4e-04f1-4d4c-9a89-1ad7a2b01ace tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:50.694896 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bcfb5b4e-04f1-4d4c-9a89-1ad7a2b01ace tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.384462 May 26 16:53:50.695477 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 26/59] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:50 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:53:50.805871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8ed64f3d-9bf1-441e-bc12-f66c2258b600 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:50.808476 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8ed64f3d-9bf1-441e-bc12-f66c2258b600 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:50.815927 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ed64f3d-9bf1-441e-bc12-f66c2258b600 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:50.817193 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ed64f3d-9bf1-441e-bc12-f66c2258b600 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:50.818178 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ed64f3d-9bf1-441e-bc12-f66c2258b600 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:50.818710 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ed64f3d-9bf1-441e-bc12-f66c2258b600 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:50.895054 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1ef00088-8204-46f3-b76d-b9e21f61d24a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:50.895930 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1ef00088-8204-46f3-b76d-b9e21f61d24a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:50.902241 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8ed64f3d-9bf1-441e-bc12-f66c2258b600 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:50.908962 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1ef00088-8204-46f3-b76d-b9e21f61d24a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:50.909600 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1ef00088-8204-46f3-b76d-b9e21f61d24a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:50.910457 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1ef00088-8204-46f3-b76d-b9e21f61d24a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:50.910904 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1ef00088-8204-46f3-b76d-b9e21f61d24a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:50.917664 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8ed64f3d-9bf1-441e-bc12-f66c2258b600 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:50.921659 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8ed64f3d-9bf1-441e-bc12-f66c2258b600 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:50.923619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8ed64f3d-9bf1-441e-bc12-f66c2258b600 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1341 microversion: 2.20 time: 0.122965 May 26 16:53:50.924783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 34/60] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:53:50 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1341 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:53:51.100089 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1ef00088-8204-46f3-b76d-b9e21f61d24a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:51.109794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1ef00088-8204-46f3-b76d-b9e21f61d24a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1322 microversion: 2.1 time: 0.220035 May 26 16:53:51.110338 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 27/61] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:50 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:51.343426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2d672ec0-28d3-4eac-ab13-695c7b40d392 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:51.344033 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2d672ec0-28d3-4eac-ab13-695c7b40d392 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:51.350532 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2d672ec0-28d3-4eac-ab13-695c7b40d392 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:51.350982 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2d672ec0-28d3-4eac-ab13-695c7b40d392 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:51.351784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2d672ec0-28d3-4eac-ab13-695c7b40d392 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:51.352218 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2d672ec0-28d3-4eac-ab13-695c7b40d392 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:51.500711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2d672ec0-28d3-4eac-ab13-695c7b40d392 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:51.508985 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2d672ec0-28d3-4eac-ab13-695c7b40d392 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.169431 May 26 16:53:51.510949 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 35/62] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:51 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:51.752470 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cdcb734d-560a-4d4d-833f-4e2dbcc6ea15 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:51.758051 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cdcb734d-560a-4d4d-833f-4e2dbcc6ea15 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:51.770083 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=4 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:51.779679 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cdcb734d-560a-4d4d-833f-4e2dbcc6ea15 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:51.781800 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cdcb734d-560a-4d4d-833f-4e2dbcc6ea15 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:51.783592 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cdcb734d-560a-4d4d-833f-4e2dbcc6ea15 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:51.784601 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cdcb734d-560a-4d4d-833f-4e2dbcc6ea15 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:51.944250 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-84835f17-bfcc-48a1-a456-b442b10c0394 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:51.944870 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-84835f17-bfcc-48a1-a456-b442b10c0394 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:51.952707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-84835f17-bfcc-48a1-a456-b442b10c0394 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:51.957793 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-84835f17-bfcc-48a1-a456-b442b10c0394 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:51.958890 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-84835f17-bfcc-48a1-a456-b442b10c0394 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:51.959342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-84835f17-bfcc-48a1-a456-b442b10c0394 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:52.202259 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-84835f17-bfcc-48a1-a456-b442b10c0394 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:52.210700 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-84835f17-bfcc-48a1-a456-b442b10c0394 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:52.212379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-84835f17-bfcc-48a1-a456-b442b10c0394 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:52.214118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-84835f17-bfcc-48a1-a456-b442b10c0394 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1351 microversion: 2.20 time: 0.273929 May 26 16:53:52.215142 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 36/63] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:53:51 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1351 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:53:52.219970 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ab9cecda-6acc-4032-94d6-5b9a48a46ab3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:52.220663 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ab9cecda-6acc-4032-94d6-5b9a48a46ab3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:52.227435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ab9cecda-6acc-4032-94d6-5b9a48a46ab3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:52.227879 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ab9cecda-6acc-4032-94d6-5b9a48a46ab3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:52.228709 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ab9cecda-6acc-4032-94d6-5b9a48a46ab3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:52.229679 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ab9cecda-6acc-4032-94d6-5b9a48a46ab3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:52.312987 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cdcb734d-560a-4d4d-833f-4e2dbcc6ea15 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:52.322630 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cdcb734d-560a-4d4d-833f-4e2dbcc6ea15 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.612988 May 26 16:53:52.324051 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 28/64] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:51 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:52.487886 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ab9cecda-6acc-4032-94d6-5b9a48a46ab3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:52.497127 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ab9cecda-6acc-4032-94d6-5b9a48a46ab3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1322 microversion: 2.1 time: 0.280833 May 26 16:53:52.516686 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 37/65] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:52 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:52.527170 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f37dc412-5c7f-45ed-bb1d-905163a39756 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:52.528284 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f37dc412-5c7f-45ed-bb1d-905163a39756 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:52.534862 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f37dc412-5c7f-45ed-bb1d-905163a39756 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:52.535313 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f37dc412-5c7f-45ed-bb1d-905163a39756 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:52.536091 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f37dc412-5c7f-45ed-bb1d-905163a39756 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:52.536524 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f37dc412-5c7f-45ed-bb1d-905163a39756 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:52.748875 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f37dc412-5c7f-45ed-bb1d-905163a39756 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:52.758777 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f37dc412-5c7f-45ed-bb1d-905163a39756 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.234939 May 26 16:53:52.763102 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 29/66] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:52 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:53.235580 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-763b4333-cbbd-4d7e-8591-c4a9d496af78 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:53.237737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-763b4333-cbbd-4d7e-8591-c4a9d496af78 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:53.247077 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-763b4333-cbbd-4d7e-8591-c4a9d496af78 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:53.250383 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-763b4333-cbbd-4d7e-8591-c4a9d496af78 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:53.250383 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-763b4333-cbbd-4d7e-8591-c4a9d496af78 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:53.250383 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-763b4333-cbbd-4d7e-8591-c4a9d496af78 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:53.343949 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f6f2be33-71a0-4dcf-8880-068d1a9fe76d tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:53.345633 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f6f2be33-71a0-4dcf-8880-068d1a9fe76d tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:53.352989 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f6f2be33-71a0-4dcf-8880-068d1a9fe76d tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:53.354370 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f6f2be33-71a0-4dcf-8880-068d1a9fe76d tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:53.355530 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f6f2be33-71a0-4dcf-8880-068d1a9fe76d tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:53.356070 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f6f2be33-71a0-4dcf-8880-068d1a9fe76d tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:53.686295 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f6f2be33-71a0-4dcf-8880-068d1a9fe76d tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:53.698121 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f6f2be33-71a0-4dcf-8880-068d1a9fe76d tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.361667 May 26 16:53:53.702003 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 30/67] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:53 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:53:53.702177 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-763b4333-cbbd-4d7e-8591-c4a9d496af78 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:53.710148 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e635a55e-b7f4-49a6-bd5a-f463d6927ca2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:53.714209 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e635a55e-b7f4-49a6-bd5a-f463d6927ca2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:53.716621 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-763b4333-cbbd-4d7e-8591-c4a9d496af78 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:53.718214 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-763b4333-cbbd-4d7e-8591-c4a9d496af78 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:53.719379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-763b4333-cbbd-4d7e-8591-c4a9d496af78 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.487969 May 26 16:53:53.720205 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 38/68] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:53:53 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:53:53.721804 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e635a55e-b7f4-49a6-bd5a-f463d6927ca2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:53.722641 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e635a55e-b7f4-49a6-bd5a-f463d6927ca2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:53.723855 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e635a55e-b7f4-49a6-bd5a-f463d6927ca2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:53.724508 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e635a55e-b7f4-49a6-bd5a-f463d6927ca2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:53.725243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=30 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:53.726096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-79d1991e-22f0-45d6-bdca-1dad41b08667 req-0122ec4b-a8df-4eb0-87b3-c4ffde567ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e432ca18-47de-4981-bc37-036d927a5c62", "tag": "aa5bb9eb-d210-4c41-8ad7-80a9d91058a7"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:53.741926 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-79d1991e-22f0-45d6-bdca-1dad41b08667 req-0122ec4b-a8df-4eb0-87b3-c4ffde567ebc service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:53.742557 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-79d1991e-22f0-45d6-bdca-1dad41b08667 req-0122ec4b-a8df-4eb0-87b3-c4ffde567ebc service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:53.760243 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-79d1991e-22f0-45d6-bdca-1dad41b08667 req-0122ec4b-a8df-4eb0-87b3-c4ffde567ebc service nova] Creating event network-changed:aa5bb9eb-d210-4c41-8ad7-80a9d91058a7 for instance e432ca18-47de-4981-bc37-036d927a5c62 on hv-cinder-83607 May 26 16:53:53.778684 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-79d1991e-22f0-45d6-bdca-1dad41b08667 req-0122ec4b-a8df-4eb0-87b3-c4ffde567ebc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056681 May 26 16:53:53.779924 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 39/69] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:53:53.787921 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-311b4754-150b-43d9-828e-ec4bf9655ae2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:53.788645 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-311b4754-150b-43d9-828e-ec4bf9655ae2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:53.798723 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-311b4754-150b-43d9-828e-ec4bf9655ae2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:53.799188 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-311b4754-150b-43d9-828e-ec4bf9655ae2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:53.800306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-311b4754-150b-43d9-828e-ec4bf9655ae2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:53.800771 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-311b4754-150b-43d9-828e-ec4bf9655ae2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:53.925856 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=6 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:54.065976 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e635a55e-b7f4-49a6-bd5a-f463d6927ca2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:54.077851 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e635a55e-b7f4-49a6-bd5a-f463d6927ca2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1322 microversion: 2.1 time: 0.374151 May 26 16:53:54.087288 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-311b4754-150b-43d9-828e-ec4bf9655ae2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:54.087865 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 31/70] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:53 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:54.090687 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-311b4754-150b-43d9-828e-ec4bf9655ae2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.308571 May 26 16:53:54.091267 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 40/71] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:53 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:54.718925 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2ba971bd-6eb1-466f-9ecc-c40eb8e377c7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:54.729071 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2ba971bd-6eb1-466f-9ecc-c40eb8e377c7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:54.729071 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2ba971bd-6eb1-466f-9ecc-c40eb8e377c7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:54.729071 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2ba971bd-6eb1-466f-9ecc-c40eb8e377c7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:54.729071 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2ba971bd-6eb1-466f-9ecc-c40eb8e377c7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:54.729485 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2ba971bd-6eb1-466f-9ecc-c40eb8e377c7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:54.738476 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e066dc5e-45e3-4b91-9724-551e370a0326 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:54.739188 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e066dc5e-45e3-4b91-9724-551e370a0326 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:54.748110 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e066dc5e-45e3-4b91-9724-551e370a0326 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:54.748555 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e066dc5e-45e3-4b91-9724-551e370a0326 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:54.749352 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e066dc5e-45e3-4b91-9724-551e370a0326 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:54.749788 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e066dc5e-45e3-4b91-9724-551e370a0326 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:55.098629 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2ba971bd-6eb1-466f-9ecc-c40eb8e377c7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:55.107744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e066dc5e-45e3-4b91-9724-551e370a0326 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:55.122167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e066dc5e-45e3-4b91-9724-551e370a0326 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:55.124055 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e066dc5e-45e3-4b91-9724-551e370a0326 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:55.132293 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e066dc5e-45e3-4b91-9724-551e370a0326 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.397877 May 26 16:53:55.133143 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 41/72] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:53:54 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:53:55.145547 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8c039486-1f71-4722-82ee-ed6a250ac055 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:55.154548 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2ba971bd-6eb1-466f-9ecc-c40eb8e377c7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.439875 May 26 16:53:55.159041 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 32/73] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:54 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:55.168159 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8c039486-1f71-4722-82ee-ed6a250ac055 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:55.189786 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-caa30a2c-370f-440f-a085-0ab1b83e4a7a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:55.193610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-caa30a2c-370f-440f-a085-0ab1b83e4a7a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:55.204258 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8c039486-1f71-4722-82ee-ed6a250ac055 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:55.205002 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8c039486-1f71-4722-82ee-ed6a250ac055 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:55.213402 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8c039486-1f71-4722-82ee-ed6a250ac055 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:55.217676 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8c039486-1f71-4722-82ee-ed6a250ac055 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:55.231464 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-caa30a2c-370f-440f-a085-0ab1b83e4a7a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:55.233447 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-caa30a2c-370f-440f-a085-0ab1b83e4a7a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:55.241194 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-caa30a2c-370f-440f-a085-0ab1b83e4a7a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:55.242309 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-caa30a2c-370f-440f-a085-0ab1b83e4a7a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:55.908960 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8c039486-1f71-4722-82ee-ed6a250ac055 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:55.910405 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-caa30a2c-370f-440f-a085-0ab1b83e4a7a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:55.920255 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8c039486-1f71-4722-82ee-ed6a250ac055 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1322 microversion: 2.1 time: 0.785833 May 26 16:53:55.932026 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 42/74] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:55 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1322 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:55.932762 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-caa30a2c-370f-440f-a085-0ab1b83e4a7a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.771608 May 26 16:53:55.933730 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 33/75] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:55 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:55.951316 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-f74aaf8c-95ef-42c5-857c-97cd13effe1d req-517bce6e-06ab-46ff-92ea-877625b67101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0daf7ae-8eab-479b-b4cb-380a68f5bfaa", "tag": "19f830e3-9d14-4893-a727-3c20d5993b34"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:55.961298 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-f74aaf8c-95ef-42c5-857c-97cd13effe1d req-517bce6e-06ab-46ff-92ea-877625b67101 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:55.961851 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-f74aaf8c-95ef-42c5-857c-97cd13effe1d req-517bce6e-06ab-46ff-92ea-877625b67101 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:55.975326 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-f74aaf8c-95ef-42c5-857c-97cd13effe1d req-517bce6e-06ab-46ff-92ea-877625b67101 service nova] Creating event network-changed:19f830e3-9d14-4893-a727-3c20d5993b34 for instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa on hv-cinder-83607 May 26 16:53:55.980620 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-f74aaf8c-95ef-42c5-857c-97cd13effe1d req-517bce6e-06ab-46ff-92ea-877625b67101 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046302 May 26 16:53:55.981520 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 43/76] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:53:56.162468 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-be1fa251-4ccc-4c2b-9cb3-25e5f68bcb64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:56.163054 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-be1fa251-4ccc-4c2b-9cb3-25e5f68bcb64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:56.175424 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be1fa251-4ccc-4c2b-9cb3-25e5f68bcb64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:56.175867 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be1fa251-4ccc-4c2b-9cb3-25e5f68bcb64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:56.177665 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be1fa251-4ccc-4c2b-9cb3-25e5f68bcb64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:56.177665 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be1fa251-4ccc-4c2b-9cb3-25e5f68bcb64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:56.197161 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f628c97b-7799-470f-956d-926e092f0e76 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:56.197950 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f628c97b-7799-470f-956d-926e092f0e76 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:56.205056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f628c97b-7799-470f-956d-926e092f0e76 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:56.206078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f628c97b-7799-470f-956d-926e092f0e76 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:56.207055 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f628c97b-7799-470f-956d-926e092f0e76 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:56.207515 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f628c97b-7799-470f-956d-926e092f0e76 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:56.412102 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-be1fa251-4ccc-4c2b-9cb3-25e5f68bcb64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:56.425726 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-be1fa251-4ccc-4c2b-9cb3-25e5f68bcb64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:56.428015 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-be1fa251-4ccc-4c2b-9cb3-25e5f68bcb64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:56.429178 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-be1fa251-4ccc-4c2b-9cb3-25e5f68bcb64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.270685 May 26 16:53:56.433303 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 34/77] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:53:56 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:53:56.443679 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f628c97b-7799-470f-956d-926e092f0e76 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:56.454219 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f628c97b-7799-470f-956d-926e092f0e76 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.263958 May 26 16:53:56.464783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 44/78] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:56 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:53:56.941868 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d123d7a5-c838-4a50-8bae-224485a5740e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:56.942849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d123d7a5-c838-4a50-8bae-224485a5740e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:56.954428 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3752a8d1-a055-4a48-95a5-d1d03af9768f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:56.955055 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3752a8d1-a055-4a48-95a5-d1d03af9768f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:56.958967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d123d7a5-c838-4a50-8bae-224485a5740e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:56.959981 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d123d7a5-c838-4a50-8bae-224485a5740e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:56.961364 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d123d7a5-c838-4a50-8bae-224485a5740e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:56.962205 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d123d7a5-c838-4a50-8bae-224485a5740e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:56.963598 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3752a8d1-a055-4a48-95a5-d1d03af9768f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:56.964371 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3752a8d1-a055-4a48-95a5-d1d03af9768f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:56.965552 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3752a8d1-a055-4a48-95a5-d1d03af9768f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:56.967001 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3752a8d1-a055-4a48-95a5-d1d03af9768f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:56.991785 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=100 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:57.312963 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d123d7a5-c838-4a50-8bae-224485a5740e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:57.323381 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d123d7a5-c838-4a50-8bae-224485a5740e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1322 microversion: 2.1 time: 0.387027 May 26 16:53:57.324697 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 35/79] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:56 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1322 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:57.407277 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3752a8d1-a055-4a48-95a5-d1d03af9768f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:57.417835 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3752a8d1-a055-4a48-95a5-d1d03af9768f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.467565 May 26 16:53:57.418421 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 45/80] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:56 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:53:57.450524 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2bec08be-7278-48ff-a060-1924a421f353 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:57.451303 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2bec08be-7278-48ff-a060-1924a421f353 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:57.462454 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2bec08be-7278-48ff-a060-1924a421f353 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:57.462454 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2bec08be-7278-48ff-a060-1924a421f353 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:57.462454 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2bec08be-7278-48ff-a060-1924a421f353 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:57.462454 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2bec08be-7278-48ff-a060-1924a421f353 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:57.472274 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-426370fb-f386-48a2-96a5-f24ce611216c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:57.473127 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-426370fb-f386-48a2-96a5-f24ce611216c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:57.483072 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-426370fb-f386-48a2-96a5-f24ce611216c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:57.483887 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-426370fb-f386-48a2-96a5-f24ce611216c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:57.484820 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-426370fb-f386-48a2-96a5-f24ce611216c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:57.485551 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-426370fb-f386-48a2-96a5-f24ce611216c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:57.523360 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:57.782358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2bec08be-7278-48ff-a060-1924a421f353 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:57.798429 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2bec08be-7278-48ff-a060-1924a421f353 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:57.799910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2bec08be-7278-48ff-a060-1924a421f353 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:57.801087 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2bec08be-7278-48ff-a060-1924a421f353 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.355911 May 26 16:53:57.801724 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 36/81] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:53:57 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:53:57.817135 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-426370fb-f386-48a2-96a5-f24ce611216c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:57.826375 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-426370fb-f386-48a2-96a5-f24ce611216c tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.359342 May 26 16:53:57.826948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 46/82] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:57 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:58.340878 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-205fa5ac-2451-41c9-846e-2865d9c92ee9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:58.341743 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-205fa5ac-2451-41c9-846e-2865d9c92ee9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:58.349440 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-205fa5ac-2451-41c9-846e-2865d9c92ee9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:58.349922 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-205fa5ac-2451-41c9-846e-2865d9c92ee9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:58.350690 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-205fa5ac-2451-41c9-846e-2865d9c92ee9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:58.351136 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-205fa5ac-2451-41c9-846e-2865d9c92ee9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:58.368636 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:58.439700 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-aad182ae-c6e7-47e0-94c7-18abf0bffda8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:58.441796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-aad182ae-c6e7-47e0-94c7-18abf0bffda8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:58.449915 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-aad182ae-c6e7-47e0-94c7-18abf0bffda8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:58.450839 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-aad182ae-c6e7-47e0-94c7-18abf0bffda8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:58.452435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-aad182ae-c6e7-47e0-94c7-18abf0bffda8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:58.453523 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-aad182ae-c6e7-47e0-94c7-18abf0bffda8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:58.880171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-205fa5ac-2451-41c9-846e-2865d9c92ee9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:58.892077 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-205fa5ac-2451-41c9-846e-2865d9c92ee9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1322 microversion: 2.1 time: 0.555665 May 26 16:53:58.893548 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 37/83] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:58 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:58.905617 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c23364be-5b78-4aed-b2c5-7837b2449f83 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:58.912646 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c23364be-5b78-4aed-b2c5-7837b2449f83 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:58.944551 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c23364be-5b78-4aed-b2c5-7837b2449f83 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:58.946693 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c23364be-5b78-4aed-b2c5-7837b2449f83 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:58.948714 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c23364be-5b78-4aed-b2c5-7837b2449f83 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:58.949571 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c23364be-5b78-4aed-b2c5-7837b2449f83 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:58.966435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-aad182ae-c6e7-47e0-94c7-18abf0bffda8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:58.975989 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-aad182ae-c6e7-47e0-94c7-18abf0bffda8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.544355 May 26 16:53:58.976940 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 47/84] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:58 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:58.983636 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-df0bb284-9fe4-4a23-8fa5-925357ca69eb tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:58.984314 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-df0bb284-9fe4-4a23-8fa5-925357ca69eb tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:58.991115 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-df0bb284-9fe4-4a23-8fa5-925357ca69eb tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:58.991643 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-df0bb284-9fe4-4a23-8fa5-925357ca69eb tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:58.992427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-df0bb284-9fe4-4a23-8fa5-925357ca69eb tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:58.992867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-df0bb284-9fe4-4a23-8fa5-925357ca69eb tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:59.213594 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c23364be-5b78-4aed-b2c5-7837b2449f83 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:59.230202 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c23364be-5b78-4aed-b2c5-7837b2449f83 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:59.232429 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c23364be-5b78-4aed-b2c5-7837b2449f83 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:59.234449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c23364be-5b78-4aed-b2c5-7837b2449f83 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.336127 May 26 16:53:59.236741 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 38/85] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:53:58 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:53:59.289133 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-df0bb284-9fe4-4a23-8fa5-925357ca69eb tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:53:59.298628 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-df0bb284-9fe4-4a23-8fa5-925357ca69eb tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.320227 May 26 16:53:59.300641 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 48/86] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:58 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:53:59.795024 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-8ace5e27-c027-494a-8e43-770e17a23335 req-04b9b802-809c-4055-a261-936cd79acb6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ecc34c3-8a11-43df-b56d-0996916a0187", "name": "network-vif-plugged", "status": "completed", "tag": "50fe6234-052f-41cc-8a4f-a24813700c3e"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:53:59.815327 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-8ace5e27-c027-494a-8e43-770e17a23335 req-04b9b802-809c-4055-a261-936cd79acb6e service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:59.815780 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-8ace5e27-c027-494a-8e43-770e17a23335 req-04b9b802-809c-4055-a261-936cd79acb6e service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:59.849303 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-8ace5e27-c027-494a-8e43-770e17a23335 req-04b9b802-809c-4055-a261-936cd79acb6e service nova] Creating event network-vif-plugged:50fe6234-052f-41cc-8a4f-a24813700c3e for instance 3ecc34c3-8a11-43df-b56d-0996916a0187 on hv-cinder-83607 May 26 16:53:59.852103 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-8ace5e27-c027-494a-8e43-770e17a23335 req-04b9b802-809c-4055-a261-936cd79acb6e service nova] Acquired lock "compute-rpcapi-router" {{(pid=124837) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 16:53:59.860081 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b2fc2c7-f5c6-40af-b45c-4b42dff57b2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:59.861910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b2fc2c7-f5c6-40af-b45c-4b42dff57b2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:59.863915 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b2fc2c7-f5c6-40af-b45c-4b42dff57b2c None None] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:59.864667 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b2fc2c7-f5c6-40af-b45c-4b42dff57b2c None None] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:59.888835 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.compute.rpcapi [None req-1b2fc2c7-f5c6-40af-b45c-4b42dff57b2c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 16:53:59.889772 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b2fc2c7-f5c6-40af-b45c-4b42dff57b2c None None] Releasing lock "compute-rpcapi-router" {{(pid=124837) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 16:53:59.922232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8b2258cc-cbe1-4754-ab58-47ce2dffd77a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:59.927091 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8b2258cc-cbe1-4754-ab58-47ce2dffd77a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:53:59.930516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1b2fc2c7-f5c6-40af-b45c-4b42dff57b2c None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.285565 May 26 16:53:59.932088 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 39/87] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:53:59.962222 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8b2258cc-cbe1-4754-ab58-47ce2dffd77a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:59.962758 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8b2258cc-cbe1-4754-ab58-47ce2dffd77a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:59.964055 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8b2258cc-cbe1-4754-ab58-47ce2dffd77a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:53:59.964055 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8b2258cc-cbe1-4754-ab58-47ce2dffd77a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:53:59.997695 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9ff3447a-a286-455e-9b3b-08d9bff191e7 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:53:59.998604 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9ff3447a-a286-455e-9b3b-08d9bff191e7 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:00.012802 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ff3447a-a286-455e-9b3b-08d9bff191e7 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:00.013352 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ff3447a-a286-455e-9b3b-08d9bff191e7 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:00.014565 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ff3447a-a286-455e-9b3b-08d9bff191e7 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:00.015267 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ff3447a-a286-455e-9b3b-08d9bff191e7 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:00.392790 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8b2258cc-cbe1-4754-ab58-47ce2dffd77a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:00.397406 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9ff3447a-a286-455e-9b3b-08d9bff191e7 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:00.403655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8b2258cc-cbe1-4754-ab58-47ce2dffd77a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1322 microversion: 2.1 time: 0.492780 May 26 16:54:00.404252 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 49/88] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:59 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1322 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:00.411029 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9ff3447a-a286-455e-9b3b-08d9bff191e7 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.417775 May 26 16:54:00.412129 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 40/89] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:53:59 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:00.418185 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-129e67d3-7a35-48f9-9954-11c70c5fb323 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:00.419114 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-129e67d3-7a35-48f9-9954-11c70c5fb323 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:00.427574 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-129e67d3-7a35-48f9-9954-11c70c5fb323 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:00.428317 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-129e67d3-7a35-48f9-9954-11c70c5fb323 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:00.429375 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-129e67d3-7a35-48f9-9954-11c70c5fb323 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:00.430268 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-129e67d3-7a35-48f9-9954-11c70c5fb323 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:00.441148 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e5152f44-0577-4ecd-911f-246ed6d609d5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:00.442498 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e5152f44-0577-4ecd-911f-246ed6d609d5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:00.452056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5152f44-0577-4ecd-911f-246ed6d609d5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:00.452514 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5152f44-0577-4ecd-911f-246ed6d609d5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:00.453843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5152f44-0577-4ecd-911f-246ed6d609d5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:00.454468 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5152f44-0577-4ecd-911f-246ed6d609d5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:00.725931 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e5152f44-0577-4ecd-911f-246ed6d609d5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:00.739512 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e5152f44-0577-4ecd-911f-246ed6d609d5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:00.744178 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e5152f44-0577-4ecd-911f-246ed6d609d5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:00.745375 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e5152f44-0577-4ecd-911f-246ed6d609d5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.339978 May 26 16:54:00.747375 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 50/90] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:00 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:54:00.782801 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-129e67d3-7a35-48f9-9954-11c70c5fb323 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:00.794948 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-129e67d3-7a35-48f9-9954-11c70c5fb323 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.380298 May 26 16:54:00.796059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 41/91] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:00 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:01.423103 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-de5a33a6-98e6-45a7-9b43-62479fce6697 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:01.423723 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-de5a33a6-98e6-45a7-9b43-62479fce6697 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:01.432796 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-32d8c7c5-9807-44d7-bab3-4b002c74433d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:01.432997 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-de5a33a6-98e6-45a7-9b43-62479fce6697 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:01.432997 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-de5a33a6-98e6-45a7-9b43-62479fce6697 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:01.433206 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-32d8c7c5-9807-44d7-bab3-4b002c74433d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:01.433317 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-de5a33a6-98e6-45a7-9b43-62479fce6697 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:01.433317 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-de5a33a6-98e6-45a7-9b43-62479fce6697 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:01.441572 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32d8c7c5-9807-44d7-bab3-4b002c74433d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:01.442259 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32d8c7c5-9807-44d7-bab3-4b002c74433d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:01.450060 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32d8c7c5-9807-44d7-bab3-4b002c74433d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:01.450060 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32d8c7c5-9807-44d7-bab3-4b002c74433d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:01.671174 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-de5a33a6-98e6-45a7-9b43-62479fce6697 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:01.683753 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-de5a33a6-98e6-45a7-9b43-62479fce6697 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1322 microversion: 2.1 time: 0.264215 May 26 16:54:01.684634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 51/92] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:01 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:01.694247 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-32d8c7c5-9807-44d7-bab3-4b002c74433d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:01.706611 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-32d8c7c5-9807-44d7-bab3-4b002c74433d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.280470 May 26 16:54:01.707941 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 42/93] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:01 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:01.765242 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e28e7c03-fb7f-4dd9-8fd8-4fc74ce35228 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:01.766012 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e28e7c03-fb7f-4dd9-8fd8-4fc74ce35228 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:01.773505 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e28e7c03-fb7f-4dd9-8fd8-4fc74ce35228 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:01.774049 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e28e7c03-fb7f-4dd9-8fd8-4fc74ce35228 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:01.776154 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e28e7c03-fb7f-4dd9-8fd8-4fc74ce35228 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:01.776654 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e28e7c03-fb7f-4dd9-8fd8-4fc74ce35228 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:01.818521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-35d3426b-6dff-4d5e-b21e-1443b64bbdbe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:01.820018 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-35d3426b-6dff-4d5e-b21e-1443b64bbdbe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:01.834621 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-35d3426b-6dff-4d5e-b21e-1443b64bbdbe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:01.835119 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-35d3426b-6dff-4d5e-b21e-1443b64bbdbe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:01.835851 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-35d3426b-6dff-4d5e-b21e-1443b64bbdbe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:01.836286 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-35d3426b-6dff-4d5e-b21e-1443b64bbdbe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:02.040471 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-35d3426b-6dff-4d5e-b21e-1443b64bbdbe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:02.047134 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e28e7c03-fb7f-4dd9-8fd8-4fc74ce35228 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:02.050053 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-35d3426b-6dff-4d5e-b21e-1443b64bbdbe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.235434 May 26 16:54:02.061468 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e28e7c03-fb7f-4dd9-8fd8-4fc74ce35228 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:02.061468 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e28e7c03-fb7f-4dd9-8fd8-4fc74ce35228 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:02.061468 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e28e7c03-fb7f-4dd9-8fd8-4fc74ce35228 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.297801 May 26 16:54:02.061789 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 52/94] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:01 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:54:02.065381 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 43/95] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:01 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:02.066840 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-f89bbab9-938c-4668-972a-d9568f9fbd0d req-d6dddb16-f094-4c8c-abe1-5e13b04364cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd6396b4-ab96-4ef1-86da-ced71936a336", "name": "network-vif-plugged", "status": "completed", "tag": "461bedf8-343c-4769-a3de-3519954e0aa0"}, {"server_uuid": "81ee3901-edb0-46c8-9b68-5792f690cf5d", "name": "network-vif-plugged", "status": "completed", "tag": "875fe38c-8738-43ba-96e1-889e5291698c"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:54:02.081344 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-f89bbab9-938c-4668-972a-d9568f9fbd0d req-d6dddb16-f094-4c8c-abe1-5e13b04364cc service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:02.082088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-f89bbab9-938c-4668-972a-d9568f9fbd0d req-d6dddb16-f094-4c8c-abe1-5e13b04364cc service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:02.104426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-f89bbab9-938c-4668-972a-d9568f9fbd0d req-d6dddb16-f094-4c8c-abe1-5e13b04364cc service nova] Creating event network-vif-plugged:461bedf8-343c-4769-a3de-3519954e0aa0 for instance dd6396b4-ab96-4ef1-86da-ced71936a336 on hv-cinder-83607 May 26 16:54:02.104946 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-f89bbab9-938c-4668-972a-d9568f9fbd0d req-d6dddb16-f094-4c8c-abe1-5e13b04364cc service nova] Creating event network-vif-plugged:875fe38c-8738-43ba-96e1-889e5291698c for instance 81ee3901-edb0-46c8-9b68-5792f690cf5d on hv-cinder-83607 May 26 16:54:02.114218 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-f89bbab9-938c-4668-972a-d9568f9fbd0d req-d6dddb16-f094-4c8c-abe1-5e13b04364cc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052664 May 26 16:54:02.114863 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 53/96] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:54:02.708953 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-21b2641e-240a-4b04-aa23-c9f6e3eb9569 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:02.709759 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-21b2641e-240a-4b04-aa23-c9f6e3eb9569 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:02.729635 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a15094a9-99fa-419d-aecc-efee0de12fbf tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:02.730926 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a15094a9-99fa-419d-aecc-efee0de12fbf tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:02.742501 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-21b2641e-240a-4b04-aa23-c9f6e3eb9569 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:02.743038 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-21b2641e-240a-4b04-aa23-c9f6e3eb9569 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:02.743844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-21b2641e-240a-4b04-aa23-c9f6e3eb9569 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:02.749199 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-21b2641e-240a-4b04-aa23-c9f6e3eb9569 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:02.756396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a15094a9-99fa-419d-aecc-efee0de12fbf tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:02.757374 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a15094a9-99fa-419d-aecc-efee0de12fbf tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:02.758357 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a15094a9-99fa-419d-aecc-efee0de12fbf tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:02.759118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a15094a9-99fa-419d-aecc-efee0de12fbf tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:03.179659 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a15094a9-99fa-419d-aecc-efee0de12fbf tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:03.184352 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-21b2641e-240a-4b04-aa23-c9f6e3eb9569 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:03.193527 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-21b2641e-240a-4b04-aa23-c9f6e3eb9569 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1322 microversion: 2.1 time: 0.488749 May 26 16:54:03.203590 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 44/97] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:02 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1322 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:03.203590 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3eeb6960-40c9-4dbb-ad01-023206ca0849 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:03.203590 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3eeb6960-40c9-4dbb-ad01-023206ca0849 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:03.206254 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a15094a9-99fa-419d-aecc-efee0de12fbf tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.483066 May 26 16:54:03.217940 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3eeb6960-40c9-4dbb-ad01-023206ca0849 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:03.218406 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3eeb6960-40c9-4dbb-ad01-023206ca0849 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:03.224362 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 54/98] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:02 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:03.224524 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3eeb6960-40c9-4dbb-ad01-023206ca0849 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:03.224524 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3eeb6960-40c9-4dbb-ad01-023206ca0849 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:03.224726 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5f3581f1-c58d-4eaf-9e62-1bf69d6e2a60 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:03.225570 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5f3581f1-c58d-4eaf-9e62-1bf69d6e2a60 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:03.234699 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5f3581f1-c58d-4eaf-9e62-1bf69d6e2a60 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:03.236095 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5f3581f1-c58d-4eaf-9e62-1bf69d6e2a60 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:03.236400 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5f3581f1-c58d-4eaf-9e62-1bf69d6e2a60 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:03.236913 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5f3581f1-c58d-4eaf-9e62-1bf69d6e2a60 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:03.526907 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3eeb6960-40c9-4dbb-ad01-023206ca0849 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:03.530566 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5f3581f1-c58d-4eaf-9e62-1bf69d6e2a60 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:03.539378 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5f3581f1-c58d-4eaf-9e62-1bf69d6e2a60 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:03.540956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5f3581f1-c58d-4eaf-9e62-1bf69d6e2a60 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:03.541966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3eeb6960-40c9-4dbb-ad01-023206ca0849 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.346249 May 26 16:54:03.542154 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5f3581f1-c58d-4eaf-9e62-1bf69d6e2a60 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.322351 May 26 16:54:03.543084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 55/99] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:03 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:54:03.543220 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 45/100] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:03 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:04.134066 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-d24163be-72b7-4b7b-b717-1701e86ac6e0 req-84b18deb-9239-45c0-8c6d-7f82717d2d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e432ca18-47de-4981-bc37-036d927a5c62", "name": "network-vif-plugged", "status": "completed", "tag": "aa5bb9eb-d210-4c41-8ad7-80a9d91058a7"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:54:04.144620 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-d24163be-72b7-4b7b-b717-1701e86ac6e0 req-84b18deb-9239-45c0-8c6d-7f82717d2d69 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:04.145823 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-d24163be-72b7-4b7b-b717-1701e86ac6e0 req-84b18deb-9239-45c0-8c6d-7f82717d2d69 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:04.162126 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-d24163be-72b7-4b7b-b717-1701e86ac6e0 req-84b18deb-9239-45c0-8c6d-7f82717d2d69 service nova] Creating event network-vif-plugged:aa5bb9eb-d210-4c41-8ad7-80a9d91058a7 for instance e432ca18-47de-4981-bc37-036d927a5c62 on hv-cinder-83607 May 26 16:54:04.177821 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-d24163be-72b7-4b7b-b717-1701e86ac6e0 req-84b18deb-9239-45c0-8c6d-7f82717d2d69 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047791 May 26 16:54:04.179149 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 56/101] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:54:04.211468 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-016b70e6-d800-4f3a-8790-c0d29e771225 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:04.212888 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-016b70e6-d800-4f3a-8790-c0d29e771225 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:04.219903 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-016b70e6-d800-4f3a-8790-c0d29e771225 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:04.220702 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-016b70e6-d800-4f3a-8790-c0d29e771225 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:04.221615 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-016b70e6-d800-4f3a-8790-c0d29e771225 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:04.222508 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-016b70e6-d800-4f3a-8790-c0d29e771225 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:04.230076 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c81c6e33-5fcd-4f29-8923-73e0edcf4c7f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:04.232805 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c81c6e33-5fcd-4f29-8923-73e0edcf4c7f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:04.238459 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c81c6e33-5fcd-4f29-8923-73e0edcf4c7f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:04.239851 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c81c6e33-5fcd-4f29-8923-73e0edcf4c7f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:04.241775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c81c6e33-5fcd-4f29-8923-73e0edcf4c7f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:04.242499 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c81c6e33-5fcd-4f29-8923-73e0edcf4c7f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:04.487192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-016b70e6-d800-4f3a-8790-c0d29e771225 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:04.513966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-016b70e6-d800-4f3a-8790-c0d29e771225 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1322 microversion: 2.1 time: 0.290325 May 26 16:54:04.513966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 46/102] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:04 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:04.514116 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c81c6e33-5fcd-4f29-8923-73e0edcf4c7f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:04.527837 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c81c6e33-5fcd-4f29-8923-73e0edcf4c7f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.306191 May 26 16:54:04.528855 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 57/103] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:04 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:04.560830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5ce7d951-f0ee-49c9-9143-53f2259d58fc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:04.561171 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-19d7a4ba-67c9-4129-974e-c6c49144b11c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:04.561862 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-19d7a4ba-67c9-4129-974e-c6c49144b11c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:04.562306 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5ce7d951-f0ee-49c9-9143-53f2259d58fc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:04.573064 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-19d7a4ba-67c9-4129-974e-c6c49144b11c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:04.575831 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-19d7a4ba-67c9-4129-974e-c6c49144b11c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:04.576725 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-19d7a4ba-67c9-4129-974e-c6c49144b11c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:04.577950 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-19d7a4ba-67c9-4129-974e-c6c49144b11c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:04.580865 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5ce7d951-f0ee-49c9-9143-53f2259d58fc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:04.581678 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5ce7d951-f0ee-49c9-9143-53f2259d58fc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:04.588585 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5ce7d951-f0ee-49c9-9143-53f2259d58fc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:04.589456 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5ce7d951-f0ee-49c9-9143-53f2259d58fc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:04.848173 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-19d7a4ba-67c9-4129-974e-c6c49144b11c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:04.858553 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-19d7a4ba-67c9-4129-974e-c6c49144b11c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:04.860114 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-19d7a4ba-67c9-4129-974e-c6c49144b11c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:04.862031 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-19d7a4ba-67c9-4129-974e-c6c49144b11c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.304961 May 26 16:54:04.862917 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 58/104] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:04 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:54:04.875913 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5ce7d951-f0ee-49c9-9143-53f2259d58fc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:04.886531 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5ce7d951-f0ee-49c9-9143-53f2259d58fc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.329791 May 26 16:54:04.887427 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 47/105] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:04 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:05.533387 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-0cb755a7-fe69-4536-98e6-f68a1c4e81a9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:05.535495 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-0cb755a7-fe69-4536-98e6-f68a1c4e81a9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:05.546767 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0cb755a7-fe69-4536-98e6-f68a1c4e81a9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:05.547532 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0cb755a7-fe69-4536-98e6-f68a1c4e81a9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:05.549537 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0cb755a7-fe69-4536-98e6-f68a1c4e81a9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:05.550838 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0cb755a7-fe69-4536-98e6-f68a1c4e81a9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:05.551302 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f1e46cca-68a9-46b5-85db-15bcfd6bb7f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:05.552630 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f1e46cca-68a9-46b5-85db-15bcfd6bb7f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:05.561399 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f1e46cca-68a9-46b5-85db-15bcfd6bb7f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:05.562070 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f1e46cca-68a9-46b5-85db-15bcfd6bb7f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:05.563192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f1e46cca-68a9-46b5-85db-15bcfd6bb7f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:05.563979 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f1e46cca-68a9-46b5-85db-15bcfd6bb7f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:05.925079 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-0cb755a7-fe69-4536-98e6-f68a1c4e81a9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:05.934389 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f1e46cca-68a9-46b5-85db-15bcfd6bb7f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:05.942718 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-0cb755a7-fe69-4536-98e6-f68a1c4e81a9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1516 microversion: 2.1 time: 0.417261 May 26 16:54:05.942951 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f1e46cca-68a9-46b5-85db-15bcfd6bb7f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.400171 May 26 16:54:05.943705 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 48/106] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:05 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:05.948326 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-72baa364-53fb-44fb-97cc-ba93b9a957e0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:05.948949 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-72baa364-53fb-44fb-97cc-ba93b9a957e0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:05.953497 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 59/107] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:05 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1516 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:05.955927 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72baa364-53fb-44fb-97cc-ba93b9a957e0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:05.956612 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72baa364-53fb-44fb-97cc-ba93b9a957e0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:05.957364 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72baa364-53fb-44fb-97cc-ba93b9a957e0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:05.957812 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72baa364-53fb-44fb-97cc-ba93b9a957e0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:05.960575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-34ea8273-58b5-4c61-b72b-38b300706a0f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:05.961284 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-34ea8273-58b5-4c61-b72b-38b300706a0f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:05.968493 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-34ea8273-58b5-4c61-b72b-38b300706a0f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:05.968934 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-34ea8273-58b5-4c61-b72b-38b300706a0f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:05.970177 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-34ea8273-58b5-4c61-b72b-38b300706a0f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:05.970617 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-34ea8273-58b5-4c61-b72b-38b300706a0f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:06.215878 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-72baa364-53fb-44fb-97cc-ba93b9a957e0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:06.217617 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-34ea8273-58b5-4c61-b72b-38b300706a0f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:06.226865 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-72baa364-53fb-44fb-97cc-ba93b9a957e0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:06.233619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-34ea8273-58b5-4c61-b72b-38b300706a0f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1315 microversion: 2.1 time: 0.273661 May 26 16:54:06.233853 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-72baa364-53fb-44fb-97cc-ba93b9a957e0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:06.234018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 60/108] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:05 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:06.234133 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-72baa364-53fb-44fb-97cc-ba93b9a957e0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.287112 May 26 16:54:06.240215 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 49/109] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:05 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:54:06.240954 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3d96911a-bb45-4048-b0eb-f8909a724016 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:54:06.242391 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3d96911a-bb45-4048-b0eb-f8909a724016 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:06.248136 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-0503c3a3-1988-4208-a374-6c177b2b48e2 req-aa33b3a3-e2f6-42fb-8b9b-10d75ab30e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0daf7ae-8eab-479b-b4cb-380a68f5bfaa", "name": "network-vif-plugged", "status": "completed", "tag": "19f830e3-9d14-4893-a727-3c20d5993b34"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:54:06.256817 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-0503c3a3-1988-4208-a374-6c177b2b48e2 req-aa33b3a3-e2f6-42fb-8b9b-10d75ab30e7c service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:06.257279 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-0503c3a3-1988-4208-a374-6c177b2b48e2 req-aa33b3a3-e2f6-42fb-8b9b-10d75ab30e7c service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:06.258788 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3d96911a-bb45-4048-b0eb-f8909a724016 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:06.259455 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3d96911a-bb45-4048-b0eb-f8909a724016 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:06.260469 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3d96911a-bb45-4048-b0eb-f8909a724016 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:06.261638 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3d96911a-bb45-4048-b0eb-f8909a724016 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:06.272857 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-0503c3a3-1988-4208-a374-6c177b2b48e2 req-aa33b3a3-e2f6-42fb-8b9b-10d75ab30e7c service nova] Creating event network-vif-plugged:19f830e3-9d14-4893-a727-3c20d5993b34 for instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa on hv-cinder-83607 May 26 16:54:06.281486 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-0503c3a3-1988-4208-a374-6c177b2b48e2 req-aa33b3a3-e2f6-42fb-8b9b-10d75ab30e7c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037018 May 26 16:54:06.293556 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 50/110] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:54:06.357108 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-3d96911a-bb45-4048-b0eb-f8909a724016 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lazy-loading 'flavor' on Instance uuid 81ee3901-edb0-46c8-9b68-5792f690cf5d {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:54:06.690308 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:06.966590 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-150e5b49-b8d1-49be-8a2e-29da92bb1163 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:06.968530 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-150e5b49-b8d1-49be-8a2e-29da92bb1163 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:06.980085 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-150e5b49-b8d1-49be-8a2e-29da92bb1163 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:06.980824 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-150e5b49-b8d1-49be-8a2e-29da92bb1163 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:06.982445 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-150e5b49-b8d1-49be-8a2e-29da92bb1163 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:06.983149 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-150e5b49-b8d1-49be-8a2e-29da92bb1163 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:07.028737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3d96911a-bb45-4048-b0eb-f8909a724016 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "POST /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d/action" status: 200 len: 32 microversion: 2.1 time: 0.797229 May 26 16:54:07.033627 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 61/111] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 26 16:54:06 2022] POST /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d/action => generated 32 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 16:54:07.057780 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-cc5ec293-1413-4f69-96bf-d5fcc735e9f7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:07.059091 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-cc5ec293-1413-4f69-96bf-d5fcc735e9f7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:07.074338 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cc5ec293-1413-4f69-96bf-d5fcc735e9f7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:07.082207 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cc5ec293-1413-4f69-96bf-d5fcc735e9f7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:07.082207 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cc5ec293-1413-4f69-96bf-d5fcc735e9f7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:07.082207 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cc5ec293-1413-4f69-96bf-d5fcc735e9f7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:07.188039 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-150e5b49-b8d1-49be-8a2e-29da92bb1163 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:07.197961 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-150e5b49-b8d1-49be-8a2e-29da92bb1163 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.238766 May 26 16:54:07.198618 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 51/112] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:06 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:07.252470 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a5a7882c-a820-4c6a-82a3-7a29193e00df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:07.253182 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a5a7882c-a820-4c6a-82a3-7a29193e00df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:07.260285 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5a7882c-a820-4c6a-82a3-7a29193e00df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:07.260747 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5a7882c-a820-4c6a-82a3-7a29193e00df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:07.261642 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5a7882c-a820-4c6a-82a3-7a29193e00df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:07.262092 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5a7882c-a820-4c6a-82a3-7a29193e00df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:07.540841 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-cc5ec293-1413-4f69-96bf-d5fcc735e9f7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:07.552323 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-cc5ec293-1413-4f69-96bf-d5fcc735e9f7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.511916 May 26 16:54:07.552925 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 62/113] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:07 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:07.557695 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b0d2ee11-6199-4688-bdb1-490326c4a706 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:07.558330 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b0d2ee11-6199-4688-bdb1-490326c4a706 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:07.578151 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b0d2ee11-6199-4688-bdb1-490326c4a706 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:07.578610 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b0d2ee11-6199-4688-bdb1-490326c4a706 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:07.579523 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b0d2ee11-6199-4688-bdb1-490326c4a706 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:07.579931 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b0d2ee11-6199-4688-bdb1-490326c4a706 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:07.605875 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a5a7882c-a820-4c6a-82a3-7a29193e00df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:07.616822 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a5a7882c-a820-4c6a-82a3-7a29193e00df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:07.618959 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a5a7882c-a820-4c6a-82a3-7a29193e00df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:07.620590 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a5a7882c-a820-4c6a-82a3-7a29193e00df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.374007 May 26 16:54:07.621787 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 52/114] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:07 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:54:07.803763 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b0d2ee11-6199-4688-bdb1-490326c4a706 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:07.818546 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b0d2ee11-6199-4688-bdb1-490326c4a706 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1503 microversion: 2.1 time: 0.264450 May 26 16:54:07.819657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 63/115] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:07 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:08.222880 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-216b8a84-8a35-4e46-a75a-662461b21cba tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:08.223712 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-216b8a84-8a35-4e46-a75a-662461b21cba tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:08.231189 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-216b8a84-8a35-4e46-a75a-662461b21cba tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:08.232388 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-216b8a84-8a35-4e46-a75a-662461b21cba tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:08.233318 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-216b8a84-8a35-4e46-a75a-662461b21cba tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:08.233825 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-216b8a84-8a35-4e46-a75a-662461b21cba tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:08.473328 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-216b8a84-8a35-4e46-a75a-662461b21cba tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:08.483753 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-216b8a84-8a35-4e46-a75a-662461b21cba tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.265864 May 26 16:54:08.484346 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 53/116] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:08 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:08.573200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-fe34fc52-85b2-4035-8a50-345e5c0b2838 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:08.573881 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-fe34fc52-85b2-4035-8a50-345e5c0b2838 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:08.582723 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fe34fc52-85b2-4035-8a50-345e5c0b2838 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:08.583164 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fe34fc52-85b2-4035-8a50-345e5c0b2838 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:08.583960 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fe34fc52-85b2-4035-8a50-345e5c0b2838 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:08.584403 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fe34fc52-85b2-4035-8a50-345e5c0b2838 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:08.648173 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-eefc60c4-f3d7-44cd-b176-033add5652e9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:08.648793 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-eefc60c4-f3d7-44cd-b176-033add5652e9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:08.658353 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-eefc60c4-f3d7-44cd-b176-033add5652e9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:08.659028 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-eefc60c4-f3d7-44cd-b176-033add5652e9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:08.659875 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-eefc60c4-f3d7-44cd-b176-033add5652e9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:08.660675 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-eefc60c4-f3d7-44cd-b176-033add5652e9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:08.792568 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-fe34fc52-85b2-4035-8a50-345e5c0b2838 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:08.804927 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-fe34fc52-85b2-4035-8a50-345e5c0b2838 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.236472 May 26 16:54:08.806780 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 64/117] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:08 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:08.869643 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-eefc60c4-f3d7-44cd-b176-033add5652e9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:08.880293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-eefc60c4-f3d7-44cd-b176-033add5652e9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:08.882120 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-eefc60c4-f3d7-44cd-b176-033add5652e9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:08.883427 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-eefc60c4-f3d7-44cd-b176-033add5652e9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.239250 May 26 16:54:08.884164 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 54/118] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:08 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:54:09.501060 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ce8fa0b9-9868-4814-a02b-eafcfae90939 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:09.501710 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ce8fa0b9-9868-4814-a02b-eafcfae90939 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:09.510888 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ce8fa0b9-9868-4814-a02b-eafcfae90939 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:09.511502 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ce8fa0b9-9868-4814-a02b-eafcfae90939 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:09.512509 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ce8fa0b9-9868-4814-a02b-eafcfae90939 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:09.513227 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ce8fa0b9-9868-4814-a02b-eafcfae90939 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:09.678418 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ce8fa0b9-9868-4814-a02b-eafcfae90939 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:09.690167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ce8fa0b9-9868-4814-a02b-eafcfae90939 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.192636 May 26 16:54:09.691202 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 65/119] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:09 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:09.823509 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-78be2ad6-d5fa-4292-b8c7-ae7c724d6877 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:09.824123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-78be2ad6-d5fa-4292-b8c7-ae7c724d6877 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:09.830518 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-78be2ad6-d5fa-4292-b8c7-ae7c724d6877 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:09.830981 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-78be2ad6-d5fa-4292-b8c7-ae7c724d6877 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:09.831742 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-78be2ad6-d5fa-4292-b8c7-ae7c724d6877 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:09.832170 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-78be2ad6-d5fa-4292-b8c7-ae7c724d6877 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:09.834989 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:09.879865 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:09.907049 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-091e61b3-d9ec-4270-ae90-68f7402fb12a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:09.907983 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-091e61b3-d9ec-4270-ae90-68f7402fb12a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:09.915143 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-091e61b3-d9ec-4270-ae90-68f7402fb12a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:09.915708 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-091e61b3-d9ec-4270-ae90-68f7402fb12a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:09.916506 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-091e61b3-d9ec-4270-ae90-68f7402fb12a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:09.917333 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-091e61b3-d9ec-4270-ae90-68f7402fb12a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:10.048348 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-78be2ad6-d5fa-4292-b8c7-ae7c724d6877 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:10.060268 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-78be2ad6-d5fa-4292-b8c7-ae7c724d6877 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.241118 May 26 16:54:10.061111 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 55/120] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:09 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:10.115959 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-091e61b3-d9ec-4270-ae90-68f7402fb12a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:10.125425 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-091e61b3-d9ec-4270-ae90-68f7402fb12a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:10.126957 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-091e61b3-d9ec-4270-ae90-68f7402fb12a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:10.128062 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-091e61b3-d9ec-4270-ae90-68f7402fb12a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.225134 May 26 16:54:10.128705 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 66/121] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:09 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:54:10.711834 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e5a7f549-97eb-47b3-b75b-65e4d25ba81e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:10.715193 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e5a7f549-97eb-47b3-b75b-65e4d25ba81e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:10.721320 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e5a7f549-97eb-47b3-b75b-65e4d25ba81e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:10.722008 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e5a7f549-97eb-47b3-b75b-65e4d25ba81e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:10.723306 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e5a7f549-97eb-47b3-b75b-65e4d25ba81e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:10.724233 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e5a7f549-97eb-47b3-b75b-65e4d25ba81e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:10.888038 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e5a7f549-97eb-47b3-b75b-65e4d25ba81e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:10.896229 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e5a7f549-97eb-47b3-b75b-65e4d25ba81e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.188577 May 26 16:54:10.896785 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 56/122] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:10 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:11.080139 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-914bb861-602f-4533-a30c-5db1c0f628e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:11.080798 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-914bb861-602f-4533-a30c-5db1c0f628e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:11.087282 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-914bb861-602f-4533-a30c-5db1c0f628e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:11.087736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-914bb861-602f-4533-a30c-5db1c0f628e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:11.090454 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-914bb861-602f-4533-a30c-5db1c0f628e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:11.090454 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-914bb861-602f-4533-a30c-5db1c0f628e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:11.147341 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-54ea7ed4-04b4-4587-9466-54e716fb20df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:11.148130 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-54ea7ed4-04b4-4587-9466-54e716fb20df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:11.155615 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-54ea7ed4-04b4-4587-9466-54e716fb20df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:11.156141 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-54ea7ed4-04b4-4587-9466-54e716fb20df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:11.157023 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-54ea7ed4-04b4-4587-9466-54e716fb20df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:11.157654 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-54ea7ed4-04b4-4587-9466-54e716fb20df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:11.294887 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-914bb861-602f-4533-a30c-5db1c0f628e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:11.303189 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-914bb861-602f-4533-a30c-5db1c0f628e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.228143 May 26 16:54:11.303798 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 67/123] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:11 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:11.333363 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-54ea7ed4-04b4-4587-9466-54e716fb20df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:11.341799 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-54ea7ed4-04b4-4587-9466-54e716fb20df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:11.343303 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-54ea7ed4-04b4-4587-9466-54e716fb20df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:11.344419 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-54ea7ed4-04b4-4587-9466-54e716fb20df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.201757 May 26 16:54:11.345313 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 57/124] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:11 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:54:11.916717 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b75f4411-46ce-4005-84ce-f17efbcc55c9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:11.918028 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b75f4411-46ce-4005-84ce-f17efbcc55c9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:11.928207 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b75f4411-46ce-4005-84ce-f17efbcc55c9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:11.928660 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b75f4411-46ce-4005-84ce-f17efbcc55c9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:11.929689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b75f4411-46ce-4005-84ce-f17efbcc55c9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:11.930130 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b75f4411-46ce-4005-84ce-f17efbcc55c9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:12.077467 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b75f4411-46ce-4005-84ce-f17efbcc55c9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:12.085503 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b75f4411-46ce-4005-84ce-f17efbcc55c9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.175035 May 26 16:54:12.086470 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 68/125] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:11 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:12.321507 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-90fd7e4d-4cd2-44cc-a230-9552a0cea500 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:12.322869 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-90fd7e4d-4cd2-44cc-a230-9552a0cea500 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:12.329150 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-90fd7e4d-4cd2-44cc-a230-9552a0cea500 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:12.329629 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-90fd7e4d-4cd2-44cc-a230-9552a0cea500 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:12.330590 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-90fd7e4d-4cd2-44cc-a230-9552a0cea500 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:12.330948 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-90fd7e4d-4cd2-44cc-a230-9552a0cea500 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:12.363954 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2b8522f9-c5fb-4ed4-bd4d-7883740591a0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:12.364667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2b8522f9-c5fb-4ed4-bd4d-7883740591a0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:12.371969 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2b8522f9-c5fb-4ed4-bd4d-7883740591a0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:12.372693 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2b8522f9-c5fb-4ed4-bd4d-7883740591a0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:12.373664 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2b8522f9-c5fb-4ed4-bd4d-7883740591a0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:12.374266 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2b8522f9-c5fb-4ed4-bd4d-7883740591a0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:12.523264 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-90fd7e4d-4cd2-44cc-a230-9552a0cea500 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:12.533824 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-90fd7e4d-4cd2-44cc-a230-9552a0cea500 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.216206 May 26 16:54:12.534407 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 58/126] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:12 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:12.563630 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2b8522f9-c5fb-4ed4-bd4d-7883740591a0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:12.579465 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2b8522f9-c5fb-4ed4-bd4d-7883740591a0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:12.582421 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2b8522f9-c5fb-4ed4-bd4d-7883740591a0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:12.584599 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2b8522f9-c5fb-4ed4-bd4d-7883740591a0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.224493 May 26 16:54:12.585670 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 69/127] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:12 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:54:13.103479 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-902b8f4a-d574-42c2-8ed7-e9ebd8520192 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:13.104096 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-902b8f4a-d574-42c2-8ed7-e9ebd8520192 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:13.112463 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-902b8f4a-d574-42c2-8ed7-e9ebd8520192 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:13.113372 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-902b8f4a-d574-42c2-8ed7-e9ebd8520192 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:13.115098 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-902b8f4a-d574-42c2-8ed7-e9ebd8520192 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:13.115799 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-902b8f4a-d574-42c2-8ed7-e9ebd8520192 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:13.286084 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-902b8f4a-d574-42c2-8ed7-e9ebd8520192 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:13.295890 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-902b8f4a-d574-42c2-8ed7-e9ebd8520192 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.196728 May 26 16:54:13.305290 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 59/128] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:13 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:13.550457 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3f5b606e-03dc-4d07-9cba-cbefa4d70520 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:13.551253 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3f5b606e-03dc-4d07-9cba-cbefa4d70520 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:13.558408 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3f5b606e-03dc-4d07-9cba-cbefa4d70520 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:13.558847 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3f5b606e-03dc-4d07-9cba-cbefa4d70520 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:13.559615 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3f5b606e-03dc-4d07-9cba-cbefa4d70520 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:13.560107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3f5b606e-03dc-4d07-9cba-cbefa4d70520 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:13.612588 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3b743b53-dd9c-4209-8ca1-f6fd381234a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:13.613246 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3b743b53-dd9c-4209-8ca1-f6fd381234a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:13.619730 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b743b53-dd9c-4209-8ca1-f6fd381234a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:13.620190 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b743b53-dd9c-4209-8ca1-f6fd381234a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:13.621655 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b743b53-dd9c-4209-8ca1-f6fd381234a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:13.621938 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b743b53-dd9c-4209-8ca1-f6fd381234a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:13.777396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3f5b606e-03dc-4d07-9cba-cbefa4d70520 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:13.797938 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3f5b606e-03dc-4d07-9cba-cbefa4d70520 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.251343 May 26 16:54:13.798712 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 70/129] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:13 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:13.828035 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3b743b53-dd9c-4209-8ca1-f6fd381234a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:13.841564 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3b743b53-dd9c-4209-8ca1-f6fd381234a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:13.843138 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3b743b53-dd9c-4209-8ca1-f6fd381234a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:13.844301 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3b743b53-dd9c-4209-8ca1-f6fd381234a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.235704 May 26 16:54:13.845127 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 60/130] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:13 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:54:14.313407 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e7b05c0c-c9b0-463e-8721-50d40937c1c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:14.314305 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e7b05c0c-c9b0-463e-8721-50d40937c1c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:14.324765 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e7b05c0c-c9b0-463e-8721-50d40937c1c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:14.325667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e7b05c0c-c9b0-463e-8721-50d40937c1c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:14.326934 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e7b05c0c-c9b0-463e-8721-50d40937c1c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:14.327632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e7b05c0c-c9b0-463e-8721-50d40937c1c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:14.486115 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e7b05c0c-c9b0-463e-8721-50d40937c1c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:14.495982 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e7b05c0c-c9b0-463e-8721-50d40937c1c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.186447 May 26 16:54:14.496958 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 71/131] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:14 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:14.822397 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f57686bd-bf44-4419-ab18-f3075bae6412 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:14.823045 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f57686bd-bf44-4419-ab18-f3075bae6412 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:14.829459 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f57686bd-bf44-4419-ab18-f3075bae6412 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:14.829917 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f57686bd-bf44-4419-ab18-f3075bae6412 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:14.830690 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f57686bd-bf44-4419-ab18-f3075bae6412 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:14.831135 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f57686bd-bf44-4419-ab18-f3075bae6412 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:14.867558 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-d91a8283-2112-45b5-ad79-54380a1bc503 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:14.869380 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-d91a8283-2112-45b5-ad79-54380a1bc503 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:14.877334 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d91a8283-2112-45b5-ad79-54380a1bc503 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:14.878433 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d91a8283-2112-45b5-ad79-54380a1bc503 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:14.879422 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d91a8283-2112-45b5-ad79-54380a1bc503 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:14.880015 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d91a8283-2112-45b5-ad79-54380a1bc503 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:15.027169 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f57686bd-bf44-4419-ab18-f3075bae6412 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:15.039918 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f57686bd-bf44-4419-ab18-f3075bae6412 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.222245 May 26 16:54:15.041838 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 61/132] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:14 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:15.063253 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d91a8283-2112-45b5-ad79-54380a1bc503 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:15.073237 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d91a8283-2112-45b5-ad79-54380a1bc503 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:15.074923 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d91a8283-2112-45b5-ad79-54380a1bc503 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:15.076066 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-d91a8283-2112-45b5-ad79-54380a1bc503 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.215255 May 26 16:54:15.076626 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 72/133] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:14 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:54:15.208182 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f4b6d7b5-563d-455f-9ec7-62b43e35484f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4ac4202-ac19-4300-be35-6efaf859ea72"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:54:15.209413 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f4b6d7b5-563d-455f-9ec7-62b43e35484f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:15.215997 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4b6d7b5-563d-455f-9ec7-62b43e35484f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:15.216445 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4b6d7b5-563d-455f-9ec7-62b43e35484f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:15.217238 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4b6d7b5-563d-455f-9ec7-62b43e35484f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:15.217690 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4b6d7b5-563d-455f-9ec7-62b43e35484f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:15.515726 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-61bc7b81-6074-4798-8cf3-561083866bac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:15.516468 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-61bc7b81-6074-4798-8cf3-561083866bac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:15.526642 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-61bc7b81-6074-4798-8cf3-561083866bac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:15.527135 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-61bc7b81-6074-4798-8cf3-561083866bac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:15.528173 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-61bc7b81-6074-4798-8cf3-561083866bac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:15.528623 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-61bc7b81-6074-4798-8cf3-561083866bac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:15.678408 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-61bc7b81-6074-4798-8cf3-561083866bac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:15.686574 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-61bc7b81-6074-4798-8cf3-561083866bac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.174966 May 26 16:54:15.687163 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 73/134] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:15 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:16.058599 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-0c03e897-bccd-4c93-aa71-6e12d1b4918a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:16.059373 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-0c03e897-bccd-4c93-aa71-6e12d1b4918a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:16.066069 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0c03e897-bccd-4c93-aa71-6e12d1b4918a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:16.066615 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0c03e897-bccd-4c93-aa71-6e12d1b4918a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:16.067396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0c03e897-bccd-4c93-aa71-6e12d1b4918a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:16.067835 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0c03e897-bccd-4c93-aa71-6e12d1b4918a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:16.205107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-0c03e897-bccd-4c93-aa71-6e12d1b4918a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:16.213456 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-0c03e897-bccd-4c93-aa71-6e12d1b4918a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.159168 May 26 16:54:16.214273 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 74/135] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:16 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:16.219130 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-45398312-a121-4d3d-b65d-364c559a52d0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:16.219816 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-45398312-a121-4d3d-b65d-364c559a52d0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:16.226878 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-45398312-a121-4d3d-b65d-364c559a52d0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:16.227338 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-45398312-a121-4d3d-b65d-364c559a52d0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:16.228120 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-45398312-a121-4d3d-b65d-364c559a52d0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:16.228567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-45398312-a121-4d3d-b65d-364c559a52d0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:16.394077 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-45398312-a121-4d3d-b65d-364c559a52d0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:16.405152 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-45398312-a121-4d3d-b65d-364c559a52d0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:16.406876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-45398312-a121-4d3d-b65d-364c559a52d0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:16.409045 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-45398312-a121-4d3d-b65d-364c559a52d0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.193809 May 26 16:54:16.416950 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 75/136] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:16 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:54:16.708037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b2d2eb87-c4c5-4b21-99a5-7c3816cf0e4f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:16.708573 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b2d2eb87-c4c5-4b21-99a5-7c3816cf0e4f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:16.710667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=100 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:16.716261 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b2d2eb87-c4c5-4b21-99a5-7c3816cf0e4f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:16.716715 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b2d2eb87-c4c5-4b21-99a5-7c3816cf0e4f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:16.717593 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b2d2eb87-c4c5-4b21-99a5-7c3816cf0e4f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:16.718036 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b2d2eb87-c4c5-4b21-99a5-7c3816cf0e4f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:16.870427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b2d2eb87-c4c5-4b21-99a5-7c3816cf0e4f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:16.877759 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b2d2eb87-c4c5-4b21-99a5-7c3816cf0e4f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.173907 May 26 16:54:16.878410 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 76/137] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:16 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:17.234317 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8b2bbb00-2789-4a0a-af9b-a032ab3348e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:17.234960 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8b2bbb00-2789-4a0a-af9b-a032ab3348e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:17.243274 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8b2bbb00-2789-4a0a-af9b-a032ab3348e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:17.243757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8b2bbb00-2789-4a0a-af9b-a032ab3348e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:17.244552 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8b2bbb00-2789-4a0a-af9b-a032ab3348e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:17.244985 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8b2bbb00-2789-4a0a-af9b-a032ab3348e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:17.392836 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8b2bbb00-2789-4a0a-af9b-a032ab3348e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:17.401147 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8b2bbb00-2789-4a0a-af9b-a032ab3348e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.172103 May 26 16:54:17.401779 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 77/138] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:17 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:17.428115 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7bf55423-fb55-49dc-bbb4-c879ab91cbcd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:17.428766 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7bf55423-fb55-49dc-bbb4-c879ab91cbcd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:17.436036 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7bf55423-fb55-49dc-bbb4-c879ab91cbcd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:17.436825 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7bf55423-fb55-49dc-bbb4-c879ab91cbcd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:17.437304 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7bf55423-fb55-49dc-bbb4-c879ab91cbcd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:17.437742 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7bf55423-fb55-49dc-bbb4-c879ab91cbcd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:17.442370 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:17.604115 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7bf55423-fb55-49dc-bbb4-c879ab91cbcd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:17.614009 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7bf55423-fb55-49dc-bbb4-c879ab91cbcd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:17.615721 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7bf55423-fb55-49dc-bbb4-c879ab91cbcd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:17.616864 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7bf55423-fb55-49dc-bbb4-c879ab91cbcd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.192786 May 26 16:54:17.617476 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 78/139] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:17 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:54:17.896331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c25a6860-ff87-4264-833d-191860e79485 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:17.896995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c25a6860-ff87-4264-833d-191860e79485 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:17.906813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c25a6860-ff87-4264-833d-191860e79485 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:17.907371 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c25a6860-ff87-4264-833d-191860e79485 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:17.908309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c25a6860-ff87-4264-833d-191860e79485 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:17.908812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c25a6860-ff87-4264-833d-191860e79485 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:18.279230 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c25a6860-ff87-4264-833d-191860e79485 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:18.287168 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c25a6860-ff87-4264-833d-191860e79485 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.395872 May 26 16:54:18.287756 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 79/140] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:17 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:18.422657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e43f1859-a599-4f0d-baf1-9195c02e5266 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:18.423279 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e43f1859-a599-4f0d-baf1-9195c02e5266 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:18.430589 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e43f1859-a599-4f0d-baf1-9195c02e5266 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:18.431216 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e43f1859-a599-4f0d-baf1-9195c02e5266 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:18.432081 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e43f1859-a599-4f0d-baf1-9195c02e5266 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:18.433074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e43f1859-a599-4f0d-baf1-9195c02e5266 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:18.621293 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e43f1859-a599-4f0d-baf1-9195c02e5266 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:18.637141 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e43f1859-a599-4f0d-baf1-9195c02e5266 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.218241 May 26 16:54:18.647092 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 80/141] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:18 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:18.647092 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-69adfb75-ebeb-440b-9c47-f5f155b5bc07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:18.648127 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-69adfb75-ebeb-440b-9c47-f5f155b5bc07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:18.674894 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69adfb75-ebeb-440b-9c47-f5f155b5bc07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:18.676006 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69adfb75-ebeb-440b-9c47-f5f155b5bc07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:18.677354 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69adfb75-ebeb-440b-9c47-f5f155b5bc07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:18.678086 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69adfb75-ebeb-440b-9c47-f5f155b5bc07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:18.836994 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-69adfb75-ebeb-440b-9c47-f5f155b5bc07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:18.848322 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-69adfb75-ebeb-440b-9c47-f5f155b5bc07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:18.849844 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-69adfb75-ebeb-440b-9c47-f5f155b5bc07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:18.850974 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-69adfb75-ebeb-440b-9c47-f5f155b5bc07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.211774 May 26 16:54:18.851535 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 81/142] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:18 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:54:19.176827 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f4b6d7b5-563d-455f-9ec7-62b43e35484f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "POST /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.972331 May 26 16:54:19.178149 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 62/143] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 26 16:54:15 2022] POST /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336/os-volume_attachments => generated 194 bytes in 3975 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:54:19.306399 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4371574f-96e2-4261-8949-28f882ffd415 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:19.307005 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4371574f-96e2-4261-8949-28f882ffd415 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:19.314639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4371574f-96e2-4261-8949-28f882ffd415 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:19.315094 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4371574f-96e2-4261-8949-28f882ffd415 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:19.316031 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4371574f-96e2-4261-8949-28f882ffd415 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:19.316554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4371574f-96e2-4261-8949-28f882ffd415 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:19.505095 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4371574f-96e2-4261-8949-28f882ffd415 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:19.514358 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4371574f-96e2-4261-8949-28f882ffd415 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1361 microversion: 2.1 time: 0.213644 May 26 16:54:19.515473 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 82/144] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:19 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:19.657825 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7d6d1e80-da52-457a-955e-2d3edfaceeb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:19.658762 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7d6d1e80-da52-457a-955e-2d3edfaceeb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:19.662505 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=87 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:19.669029 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d6d1e80-da52-457a-955e-2d3edfaceeb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:19.669524 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d6d1e80-da52-457a-955e-2d3edfaceeb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:19.672363 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d6d1e80-da52-457a-955e-2d3edfaceeb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:19.672363 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d6d1e80-da52-457a-955e-2d3edfaceeb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:19.834431 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7d6d1e80-da52-457a-955e-2d3edfaceeb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:19.845993 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7d6d1e80-da52-457a-955e-2d3edfaceeb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.192602 May 26 16:54:19.846584 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 63/145] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:19 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:19.877121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-fc9229a8-9651-421b-a83b-7c15b3e6d15b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:19.877779 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-fc9229a8-9651-421b-a83b-7c15b3e6d15b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:19.886172 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fc9229a8-9651-421b-a83b-7c15b3e6d15b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:19.886635 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fc9229a8-9651-421b-a83b-7c15b3e6d15b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:19.887422 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fc9229a8-9651-421b-a83b-7c15b3e6d15b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:19.887939 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fc9229a8-9651-421b-a83b-7c15b3e6d15b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:20.042182 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-fc9229a8-9651-421b-a83b-7c15b3e6d15b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:20.058219 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-fc9229a8-9651-421b-a83b-7c15b3e6d15b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:20.062123 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-fc9229a8-9651-421b-a83b-7c15b3e6d15b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:20.064236 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-fc9229a8-9651-421b-a83b-7c15b3e6d15b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.191245 May 26 16:54:20.064836 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 83/146] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:19 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:54:20.636072 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b5a3e0e7-0110-46d8-8eca-028f39e48e11 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:20.636072 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b5a3e0e7-0110-46d8-8eca-028f39e48e11 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:20.636072 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b5a3e0e7-0110-46d8-8eca-028f39e48e11 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:20.636072 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b5a3e0e7-0110-46d8-8eca-028f39e48e11 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:20.637336 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b5a3e0e7-0110-46d8-8eca-028f39e48e11 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:20.637336 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b5a3e0e7-0110-46d8-8eca-028f39e48e11 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:20.758849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b5a3e0e7-0110-46d8-8eca-028f39e48e11 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:20.804416 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b5a3e0e7-0110-46d8-8eca-028f39e48e11 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1547 microversion: 2.1 time: 0.240121 May 26 16:54:20.804416 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 64/147] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:20 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1547 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:20.818049 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5cc66027-4eaf-4272-9462-b01cc92f5ca4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:20.818648 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5cc66027-4eaf-4272-9462-b01cc92f5ca4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:20.826849 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5cc66027-4eaf-4272-9462-b01cc92f5ca4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:20.827659 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5cc66027-4eaf-4272-9462-b01cc92f5ca4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:20.828709 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5cc66027-4eaf-4272-9462-b01cc92f5ca4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:20.829243 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5cc66027-4eaf-4272-9462-b01cc92f5ca4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:20.866792 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-df28b0db-d4be-419f-a696-5a98ad2109c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:20.873446 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-df28b0db-d4be-419f-a696-5a98ad2109c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:20.879173 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df28b0db-d4be-419f-a696-5a98ad2109c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:20.879889 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df28b0db-d4be-419f-a696-5a98ad2109c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:20.881226 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df28b0db-d4be-419f-a696-5a98ad2109c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:20.882079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df28b0db-d4be-419f-a696-5a98ad2109c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:20.934887 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5cc66027-4eaf-4272-9462-b01cc92f5ca4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121474 May 26 16:54:20.935853 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 84/148] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 26 16:54:20 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:54:21.062468 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-df28b0db-d4be-419f-a696-5a98ad2109c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:21.086934 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-df28b0db-d4be-419f-a696-5a98ad2109c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.222961 May 26 16:54:21.099081 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 65/149] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:20 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:21.107301 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-d12f114e-b20f-491e-96e7-00bb40f46c6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:21.108314 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-d12f114e-b20f-491e-96e7-00bb40f46c6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:21.123999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d12f114e-b20f-491e-96e7-00bb40f46c6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:21.123999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d12f114e-b20f-491e-96e7-00bb40f46c6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:21.123999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d12f114e-b20f-491e-96e7-00bb40f46c6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:21.123999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d12f114e-b20f-491e-96e7-00bb40f46c6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:21.298822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d12f114e-b20f-491e-96e7-00bb40f46c6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:21.307860 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d12f114e-b20f-491e-96e7-00bb40f46c6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:21.309979 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d12f114e-b20f-491e-96e7-00bb40f46c6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:21.320871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-d12f114e-b20f-491e-96e7-00bb40f46c6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1406 microversion: 2.20 time: 0.230001 May 26 16:54:21.322023 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 85/150] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:21 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:54:22.107189 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-46c62f14-5c98-408b-b8ed-d2714cf242dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:22.107967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-46c62f14-5c98-408b-b8ed-d2714cf242dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:22.116247 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-46c62f14-5c98-408b-b8ed-d2714cf242dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:22.116247 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-46c62f14-5c98-408b-b8ed-d2714cf242dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:22.116583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-46c62f14-5c98-408b-b8ed-d2714cf242dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:22.117117 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-46c62f14-5c98-408b-b8ed-d2714cf242dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:22.310353 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-46c62f14-5c98-408b-b8ed-d2714cf242dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:22.322304 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-46c62f14-5c98-408b-b8ed-d2714cf242dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.218638 May 26 16:54:22.324761 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 66/151] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:22 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:22.342578 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7037059d-2c9c-4d79-a4a5-c92c84fae7d3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:22.343458 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7037059d-2c9c-4d79-a4a5-c92c84fae7d3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:22.353028 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7037059d-2c9c-4d79-a4a5-c92c84fae7d3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:22.353548 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7037059d-2c9c-4d79-a4a5-c92c84fae7d3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:22.354380 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7037059d-2c9c-4d79-a4a5-c92c84fae7d3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:22.354866 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7037059d-2c9c-4d79-a4a5-c92c84fae7d3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:22.549334 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7037059d-2c9c-4d79-a4a5-c92c84fae7d3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:22.559028 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7037059d-2c9c-4d79-a4a5-c92c84fae7d3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:22.560588 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7037059d-2c9c-4d79-a4a5-c92c84fae7d3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:22.561810 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7037059d-2c9c-4d79-a4a5-c92c84fae7d3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1599 microversion: 2.20 time: 0.225214 May 26 16:54:22.562411 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 86/152] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:54:22 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:54:22.581952 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-34b13481-7a77-4f1a-ae4d-532e5f276855 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:22.582346 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-34b13481-7a77-4f1a-ae4d-532e5f276855 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:22.588581 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34b13481-7a77-4f1a-ae4d-532e5f276855 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:22.589037 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34b13481-7a77-4f1a-ae4d-532e5f276855 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:22.589894 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34b13481-7a77-4f1a-ae4d-532e5f276855 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:22.590338 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34b13481-7a77-4f1a-ae4d-532e5f276855 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:22.688124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-34b13481-7a77-4f1a-ae4d-532e5f276855 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.110185 May 26 16:54:22.688811 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 67/153] 10.222.0.48 () {60 vars in 1315 bytes} [Thu May 26 16:54:22 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:54:22.787191 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-4af352e5-8ba6-4246-9642-de1459b3b363 req-dac30f4d-b4bd-4c88-8ab0-2e111f0e3b95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e432ca18-47de-4981-bc37-036d927a5c62", "tag": "aa5bb9eb-d210-4c41-8ad7-80a9d91058a7"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:54:22.812030 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-4af352e5-8ba6-4246-9642-de1459b3b363 req-dac30f4d-b4bd-4c88-8ab0-2e111f0e3b95 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:22.813517 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-4af352e5-8ba6-4246-9642-de1459b3b363 req-dac30f4d-b4bd-4c88-8ab0-2e111f0e3b95 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:22.832278 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-4af352e5-8ba6-4246-9642-de1459b3b363 req-dac30f4d-b4bd-4c88-8ab0-2e111f0e3b95 service nova] Creating event network-changed:aa5bb9eb-d210-4c41-8ad7-80a9d91058a7 for instance e432ca18-47de-4981-bc37-036d927a5c62 on hv-cinder-83607 May 26 16:54:22.838859 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-4af352e5-8ba6-4246-9642-de1459b3b363 req-dac30f4d-b4bd-4c88-8ab0-2e111f0e3b95 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055611 May 26 16:54:22.839746 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 87/154] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:54:23.342696 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b46b3c78-ec20-4e62-8b96-26fa620d895a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:23.344291 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b46b3c78-ec20-4e62-8b96-26fa620d895a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:23.351406 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b46b3c78-ec20-4e62-8b96-26fa620d895a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:23.354566 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b46b3c78-ec20-4e62-8b96-26fa620d895a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:23.354566 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b46b3c78-ec20-4e62-8b96-26fa620d895a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:23.354566 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b46b3c78-ec20-4e62-8b96-26fa620d895a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:23.665852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b46b3c78-ec20-4e62-8b96-26fa620d895a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:23.675094 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b46b3c78-ec20-4e62-8b96-26fa620d895a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.336656 May 26 16:54:23.675680 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 68/155] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:23 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:24.254239 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-97fa0177-be74-4daf-9d76-a02e69d9a336 req-c55d5b2c-4e1b-4950-baff-3adf1503f758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0daf7ae-8eab-479b-b4cb-380a68f5bfaa", "tag": "19f830e3-9d14-4893-a727-3c20d5993b34"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:54:24.273827 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-97fa0177-be74-4daf-9d76-a02e69d9a336 req-c55d5b2c-4e1b-4950-baff-3adf1503f758 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:24.273827 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-97fa0177-be74-4daf-9d76-a02e69d9a336 req-c55d5b2c-4e1b-4950-baff-3adf1503f758 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:24.296927 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-97fa0177-be74-4daf-9d76-a02e69d9a336 req-c55d5b2c-4e1b-4950-baff-3adf1503f758 service nova] Creating event network-changed:19f830e3-9d14-4893-a727-3c20d5993b34 for instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa on hv-cinder-83607 May 26 16:54:24.306647 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-97fa0177-be74-4daf-9d76-a02e69d9a336 req-c55d5b2c-4e1b-4950-baff-3adf1503f758 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059877 May 26 16:54:24.308145 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 88/156] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:54:24.700343 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-11298d7e-d554-4e13-be8f-5b39476d053e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:24.700979 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-11298d7e-d554-4e13-be8f-5b39476d053e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:24.714241 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-11298d7e-d554-4e13-be8f-5b39476d053e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:24.714858 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-11298d7e-d554-4e13-be8f-5b39476d053e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:24.715766 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-11298d7e-d554-4e13-be8f-5b39476d053e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:24.716082 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-11298d7e-d554-4e13-be8f-5b39476d053e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:25.070230 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-11298d7e-d554-4e13-be8f-5b39476d053e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:25.082406 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-11298d7e-d554-4e13-be8f-5b39476d053e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.387058 May 26 16:54:25.083272 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 69/157] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:24 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:26.100734 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-fb02ea18-f052-4812-95b0-01b5d16e8202 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:26.101565 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-fb02ea18-f052-4812-95b0-01b5d16e8202 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:26.109859 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fb02ea18-f052-4812-95b0-01b5d16e8202 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:26.110388 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fb02ea18-f052-4812-95b0-01b5d16e8202 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:26.111309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fb02ea18-f052-4812-95b0-01b5d16e8202 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:26.111822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fb02ea18-f052-4812-95b0-01b5d16e8202 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:26.385094 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-fb02ea18-f052-4812-95b0-01b5d16e8202 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:26.395417 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-fb02ea18-f052-4812-95b0-01b5d16e8202 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.299063 May 26 16:54:26.397673 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 89/158] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:26 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:27.416404 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8b954884-ba5c-4502-86c3-614021bbee2c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:27.417028 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8b954884-ba5c-4502-86c3-614021bbee2c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:27.425069 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8b954884-ba5c-4502-86c3-614021bbee2c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:27.425660 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8b954884-ba5c-4502-86c3-614021bbee2c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:27.426466 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8b954884-ba5c-4502-86c3-614021bbee2c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:27.429152 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8b954884-ba5c-4502-86c3-614021bbee2c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:27.591962 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8b954884-ba5c-4502-86c3-614021bbee2c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:27.594225 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:27.600579 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8b954884-ba5c-4502-86c3-614021bbee2c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.188349 May 26 16:54:27.601190 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 70/159] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:27 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:28.624263 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-75477a46-55de-4dd1-b634-b29929b8d4eb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:28.624886 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-75477a46-55de-4dd1-b634-b29929b8d4eb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:28.631368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-75477a46-55de-4dd1-b634-b29929b8d4eb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:28.631818 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-75477a46-55de-4dd1-b634-b29929b8d4eb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:28.632596 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-75477a46-55de-4dd1-b634-b29929b8d4eb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:28.633047 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-75477a46-55de-4dd1-b634-b29929b8d4eb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:28.770224 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-75477a46-55de-4dd1-b634-b29929b8d4eb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:28.778544 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-75477a46-55de-4dd1-b634-b29929b8d4eb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.159590 May 26 16:54:28.779129 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 90/160] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:28 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:29.797104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-70801a1b-90db-4f2c-86a4-ea6e639fc3e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:29.797831 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-70801a1b-90db-4f2c-86a4-ea6e639fc3e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:29.805244 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-70801a1b-90db-4f2c-86a4-ea6e639fc3e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:29.805802 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-70801a1b-90db-4f2c-86a4-ea6e639fc3e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:29.806589 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-70801a1b-90db-4f2c-86a4-ea6e639fc3e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:29.807028 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-70801a1b-90db-4f2c-86a4-ea6e639fc3e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:29.959834 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-70801a1b-90db-4f2c-86a4-ea6e639fc3e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:29.968923 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-70801a1b-90db-4f2c-86a4-ea6e639fc3e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.176306 May 26 16:54:29.969538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 71/161] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:29 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:30.988479 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ded78a99-8873-463b-9087-9d5fd652a6ba tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:30.989135 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ded78a99-8873-463b-9087-9d5fd652a6ba tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:30.996731 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ded78a99-8873-463b-9087-9d5fd652a6ba tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:30.997163 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ded78a99-8873-463b-9087-9d5fd652a6ba tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:30.997981 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ded78a99-8873-463b-9087-9d5fd652a6ba tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:30.998430 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ded78a99-8873-463b-9087-9d5fd652a6ba tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:31.188679 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ded78a99-8873-463b-9087-9d5fd652a6ba tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:31.196927 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ded78a99-8873-463b-9087-9d5fd652a6ba tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.213229 May 26 16:54:31.197551 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 91/162] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:30 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:32.214685 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2227387f-4a13-430d-84f1-a8b2d373f653 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:32.215410 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2227387f-4a13-430d-84f1-a8b2d373f653 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:32.222480 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2227387f-4a13-430d-84f1-a8b2d373f653 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:32.222919 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2227387f-4a13-430d-84f1-a8b2d373f653 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:32.223705 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2227387f-4a13-430d-84f1-a8b2d373f653 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:32.224176 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2227387f-4a13-430d-84f1-a8b2d373f653 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:32.391784 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2227387f-4a13-430d-84f1-a8b2d373f653 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:32.401694 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2227387f-4a13-430d-84f1-a8b2d373f653 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.190964 May 26 16:54:32.402280 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 72/163] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:32 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:33.420267 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-87ea0019-2367-4791-971b-e352bb15a5aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:33.421159 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-87ea0019-2367-4791-971b-e352bb15a5aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:33.429232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-87ea0019-2367-4791-971b-e352bb15a5aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:33.429716 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-87ea0019-2367-4791-971b-e352bb15a5aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:33.431108 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-87ea0019-2367-4791-971b-e352bb15a5aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:33.431810 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-87ea0019-2367-4791-971b-e352bb15a5aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:33.648340 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-87ea0019-2367-4791-971b-e352bb15a5aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:33.657679 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-87ea0019-2367-4791-971b-e352bb15a5aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.241485 May 26 16:54:33.658494 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 92/164] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:33 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:34.693104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-61a9222f-0bb5-4c5b-935d-3b38564435d8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:34.694489 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-61a9222f-0bb5-4c5b-935d-3b38564435d8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:34.706521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-61a9222f-0bb5-4c5b-935d-3b38564435d8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:34.708440 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-61a9222f-0bb5-4c5b-935d-3b38564435d8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:34.710924 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-61a9222f-0bb5-4c5b-935d-3b38564435d8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:34.712213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-61a9222f-0bb5-4c5b-935d-3b38564435d8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:34.913904 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-61a9222f-0bb5-4c5b-935d-3b38564435d8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:34.924280 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-61a9222f-0bb5-4c5b-935d-3b38564435d8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.248382 May 26 16:54:34.924280 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 73/165] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:34 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:35.941880 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2490e528-2476-44b4-9bdf-93a907be0418 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:35.942472 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2490e528-2476-44b4-9bdf-93a907be0418 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:35.949017 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2490e528-2476-44b4-9bdf-93a907be0418 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:35.949500 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2490e528-2476-44b4-9bdf-93a907be0418 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:35.950363 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2490e528-2476-44b4-9bdf-93a907be0418 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:35.951005 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2490e528-2476-44b4-9bdf-93a907be0418 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:36.113925 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2490e528-2476-44b4-9bdf-93a907be0418 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:36.125685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2490e528-2476-44b4-9bdf-93a907be0418 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.188471 May 26 16:54:36.131149 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 93/166] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:35 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:37.146919 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ba597e69-6f40-46e4-b316-47e703677e91 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:37.147730 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ba597e69-6f40-46e4-b316-47e703677e91 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:37.157079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ba597e69-6f40-46e4-b316-47e703677e91 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:37.157555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ba597e69-6f40-46e4-b316-47e703677e91 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:37.158334 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ba597e69-6f40-46e4-b316-47e703677e91 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:37.159436 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ba597e69-6f40-46e4-b316-47e703677e91 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:37.320434 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ba597e69-6f40-46e4-b316-47e703677e91 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:37.332835 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ba597e69-6f40-46e4-b316-47e703677e91 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.189844 May 26 16:54:37.333729 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 74/167] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:37 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:38.357852 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b23d096c-5b88-44dc-ad6e-4f11bebf06c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:38.359163 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b23d096c-5b88-44dc-ad6e-4f11bebf06c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:38.369367 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b23d096c-5b88-44dc-ad6e-4f11bebf06c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:38.370057 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b23d096c-5b88-44dc-ad6e-4f11bebf06c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:38.371429 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b23d096c-5b88-44dc-ad6e-4f11bebf06c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:38.371872 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b23d096c-5b88-44dc-ad6e-4f11bebf06c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:38.544080 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b23d096c-5b88-44dc-ad6e-4f11bebf06c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:38.552995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b23d096c-5b88-44dc-ad6e-4f11bebf06c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.202497 May 26 16:54:38.553927 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 94/168] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:38 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:39.577282 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5aea1977-9048-40ee-8489-ee17febe2de1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:39.578312 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5aea1977-9048-40ee-8489-ee17febe2de1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:39.588820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5aea1977-9048-40ee-8489-ee17febe2de1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:39.589418 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5aea1977-9048-40ee-8489-ee17febe2de1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:39.590206 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5aea1977-9048-40ee-8489-ee17febe2de1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:39.590722 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5aea1977-9048-40ee-8489-ee17febe2de1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:39.738185 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5aea1977-9048-40ee-8489-ee17febe2de1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:39.746970 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5aea1977-9048-40ee-8489-ee17febe2de1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.176855 May 26 16:54:39.747548 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 75/169] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:39 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:40.766510 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4e85f899-8f32-4178-8390-0598f62fced6 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:40.767508 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4e85f899-8f32-4178-8390-0598f62fced6 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:40.777466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4e85f899-8f32-4178-8390-0598f62fced6 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:40.777930 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4e85f899-8f32-4178-8390-0598f62fced6 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:40.779056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4e85f899-8f32-4178-8390-0598f62fced6 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:40.779578 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4e85f899-8f32-4178-8390-0598f62fced6 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:40.949824 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4e85f899-8f32-4178-8390-0598f62fced6 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:40.965117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4e85f899-8f32-4178-8390-0598f62fced6 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.204164 May 26 16:54:40.966310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 95/170] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:40 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:41.992384 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a64e61c9-d191-4ba6-ab00-349b34d5cbb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:41.993878 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a64e61c9-d191-4ba6-ab00-349b34d5cbb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:42.000957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a64e61c9-d191-4ba6-ab00-349b34d5cbb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:42.001422 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a64e61c9-d191-4ba6-ab00-349b34d5cbb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:42.002199 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a64e61c9-d191-4ba6-ab00-349b34d5cbb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:42.002659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a64e61c9-d191-4ba6-ab00-349b34d5cbb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:42.173309 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a64e61c9-d191-4ba6-ab00-349b34d5cbb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:42.193997 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a64e61c9-d191-4ba6-ab00-349b34d5cbb0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.200699 May 26 16:54:42.193997 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 76/171] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:41 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:43.211471 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-eddc41a1-2f07-4569-b042-090ec3e74be3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:43.212072 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-eddc41a1-2f07-4569-b042-090ec3e74be3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:43.222280 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eddc41a1-2f07-4569-b042-090ec3e74be3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:43.223160 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eddc41a1-2f07-4569-b042-090ec3e74be3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:43.224641 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eddc41a1-2f07-4569-b042-090ec3e74be3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:43.225532 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eddc41a1-2f07-4569-b042-090ec3e74be3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:43.257344 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=100 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:43.420522 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-eddc41a1-2f07-4569-b042-090ec3e74be3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:43.433334 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-eddc41a1-2f07-4569-b042-090ec3e74be3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.226055 May 26 16:54:43.434318 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 96/172] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:43 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:44.456116 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b0fedff3-ce08-4311-8f98-0b657fdc6ad8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:44.456880 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b0fedff3-ce08-4311-8f98-0b657fdc6ad8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:44.466601 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0fedff3-ce08-4311-8f98-0b657fdc6ad8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:44.467423 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0fedff3-ce08-4311-8f98-0b657fdc6ad8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:44.468847 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0fedff3-ce08-4311-8f98-0b657fdc6ad8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:44.469717 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0fedff3-ce08-4311-8f98-0b657fdc6ad8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:44.670775 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b0fedff3-ce08-4311-8f98-0b657fdc6ad8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:44.680018 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b0fedff3-ce08-4311-8f98-0b657fdc6ad8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.228554 May 26 16:54:44.681144 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 77/173] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:44 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:45.700407 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-07e292e7-ea66-4743-870f-dc41860efcf7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:45.701209 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-07e292e7-ea66-4743-870f-dc41860efcf7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:45.711207 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-07e292e7-ea66-4743-870f-dc41860efcf7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:45.715206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-07e292e7-ea66-4743-870f-dc41860efcf7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:45.715206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-07e292e7-ea66-4743-870f-dc41860efcf7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:45.715206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-07e292e7-ea66-4743-870f-dc41860efcf7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:45.913869 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-07e292e7-ea66-4743-870f-dc41860efcf7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:45.922770 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-07e292e7-ea66-4743-870f-dc41860efcf7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.227283 May 26 16:54:45.923438 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 97/174] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:45 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:46.584627 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-46a8a026-a29f-4c9b-ad83-47d79ca99413 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:46.585397 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-46a8a026-a29f-4c9b-ad83-47d79ca99413 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:46.594590 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-46a8a026-a29f-4c9b-ad83-47d79ca99413 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:46.595147 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-46a8a026-a29f-4c9b-ad83-47d79ca99413 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:46.596533 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-46a8a026-a29f-4c9b-ad83-47d79ca99413 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:46.597287 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-46a8a026-a29f-4c9b-ad83-47d79ca99413 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:46.635053 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-46a8a026-a29f-4c9b-ad83-47d79ca99413 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:54:46.954632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a655e749-aa69-4301-a098-ab000aec5883 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:46.955875 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a655e749-aa69-4301-a098-ab000aec5883 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:46.968769 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a655e749-aa69-4301-a098-ab000aec5883 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:46.969746 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a655e749-aa69-4301-a098-ab000aec5883 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:46.970869 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a655e749-aa69-4301-a098-ab000aec5883 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:46.971321 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a655e749-aa69-4301-a098-ab000aec5883 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:47.104639 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-46a8a026-a29f-4c9b-ad83-47d79ca99413 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 204 len: 0 microversion: 2.1 time: 0.524593 May 26 16:54:47.105839 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 78/175] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 16:54:46 2022] DELETE /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 16:54:47.118458 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8b35124c-a584-480a-83f4-bc24ddd7caef tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:47.119276 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8b35124c-a584-480a-83f4-bc24ddd7caef tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:47.127765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8b35124c-a584-480a-83f4-bc24ddd7caef tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:47.128671 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8b35124c-a584-480a-83f4-bc24ddd7caef tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:47.129633 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8b35124c-a584-480a-83f4-bc24ddd7caef tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:47.130087 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8b35124c-a584-480a-83f4-bc24ddd7caef tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:47.185395 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a655e749-aa69-4301-a098-ab000aec5883 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:47.198071 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a655e749-aa69-4301-a098-ab000aec5883 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.257153 May 26 16:54:47.199490 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 98/176] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:46 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:47.351279 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8b35124c-a584-480a-83f4-bc24ddd7caef tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:47.381808 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8b35124c-a584-480a-83f4-bc24ddd7caef tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1555 microversion: 2.1 time: 0.270136 May 26 16:54:47.383023 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 79/177] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:47 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1555 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:48.225030 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f78581bf-d455-47b8-a6a4-c3c3af4eb9c2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:48.225682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f78581bf-d455-47b8-a6a4-c3c3af4eb9c2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:48.227678 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=46 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:48.236838 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f78581bf-d455-47b8-a6a4-c3c3af4eb9c2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:48.237329 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f78581bf-d455-47b8-a6a4-c3c3af4eb9c2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:48.238159 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f78581bf-d455-47b8-a6a4-c3c3af4eb9c2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:48.239209 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f78581bf-d455-47b8-a6a4-c3c3af4eb9c2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:48.404849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0efbaf0d-f54d-4173-bcf7-e94d4fb35aa7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:48.406149 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0efbaf0d-f54d-4173-bcf7-e94d4fb35aa7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:48.414747 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f78581bf-d455-47b8-a6a4-c3c3af4eb9c2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:48.416797 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0efbaf0d-f54d-4173-bcf7-e94d4fb35aa7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:48.416797 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0efbaf0d-f54d-4173-bcf7-e94d4fb35aa7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:48.416797 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0efbaf0d-f54d-4173-bcf7-e94d4fb35aa7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:48.416797 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0efbaf0d-f54d-4173-bcf7-e94d4fb35aa7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:48.428019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f78581bf-d455-47b8-a6a4-c3c3af4eb9c2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.207239 May 26 16:54:48.428810 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 99/178] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:48 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:48.613786 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0efbaf0d-f54d-4173-bcf7-e94d4fb35aa7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:48.632899 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0efbaf0d-f54d-4173-bcf7-e94d4fb35aa7 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1555 microversion: 2.1 time: 0.234063 May 26 16:54:48.634528 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 80/179] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:48 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1555 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:49.452110 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8f5447ce-3afb-47da-a1ab-cb6a2582da5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:49.453126 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8f5447ce-3afb-47da-a1ab-cb6a2582da5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:49.463142 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8f5447ce-3afb-47da-a1ab-cb6a2582da5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:49.463843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8f5447ce-3afb-47da-a1ab-cb6a2582da5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:49.465095 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8f5447ce-3afb-47da-a1ab-cb6a2582da5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:49.465811 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8f5447ce-3afb-47da-a1ab-cb6a2582da5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:49.647278 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8f5447ce-3afb-47da-a1ab-cb6a2582da5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:49.660258 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0b186334-f861-4d58-8b50-c0622382f8e8 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:49.661148 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8f5447ce-3afb-47da-a1ab-cb6a2582da5c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.214783 May 26 16:54:49.661359 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0b186334-f861-4d58-8b50-c0622382f8e8 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:49.661752 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 100/180] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:49 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:49.676264 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b186334-f861-4d58-8b50-c0622382f8e8 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:49.677069 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b186334-f861-4d58-8b50-c0622382f8e8 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:49.678551 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b186334-f861-4d58-8b50-c0622382f8e8 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:49.679352 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b186334-f861-4d58-8b50-c0622382f8e8 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:49.845830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0b186334-f861-4d58-8b50-c0622382f8e8 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:49.861040 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0b186334-f861-4d58-8b50-c0622382f8e8 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1555 microversion: 2.1 time: 0.204986 May 26 16:54:49.862170 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 81/181] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:49 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1555 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:50.683547 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-44cdab6c-28f9-4f71-850b-f5eebdf65e35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:50.684147 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-44cdab6c-28f9-4f71-850b-f5eebdf65e35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:50.692569 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-44cdab6c-28f9-4f71-850b-f5eebdf65e35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:50.692914 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-44cdab6c-28f9-4f71-850b-f5eebdf65e35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:50.693716 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-44cdab6c-28f9-4f71-850b-f5eebdf65e35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:50.694152 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-44cdab6c-28f9-4f71-850b-f5eebdf65e35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:50.849804 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-44cdab6c-28f9-4f71-850b-f5eebdf65e35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:50.860355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-44cdab6c-28f9-4f71-850b-f5eebdf65e35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.180338 May 26 16:54:50.861294 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 101/182] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:50 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:50.884818 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3101ebe7-0c87-4430-83dd-2a79f91ee6ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:50.885945 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3101ebe7-0c87-4430-83dd-2a79f91ee6ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:50.890050 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:50.898529 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3101ebe7-0c87-4430-83dd-2a79f91ee6ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:50.903357 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3101ebe7-0c87-4430-83dd-2a79f91ee6ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:50.903357 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3101ebe7-0c87-4430-83dd-2a79f91ee6ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:50.903357 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3101ebe7-0c87-4430-83dd-2a79f91ee6ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:51.090430 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3101ebe7-0c87-4430-83dd-2a79f91ee6ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:51.099488 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3101ebe7-0c87-4430-83dd-2a79f91ee6ec tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1555 microversion: 2.1 time: 0.222296 May 26 16:54:51.100084 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 82/183] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:50 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1555 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:51.888868 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5440c7f5-a8d8-4bc2-8d88-1b4e23d9d9e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:51.890121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5440c7f5-a8d8-4bc2-8d88-1b4e23d9d9e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:51.901541 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5440c7f5-a8d8-4bc2-8d88-1b4e23d9d9e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:51.902279 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5440c7f5-a8d8-4bc2-8d88-1b4e23d9d9e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:51.903735 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5440c7f5-a8d8-4bc2-8d88-1b4e23d9d9e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:51.904483 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5440c7f5-a8d8-4bc2-8d88-1b4e23d9d9e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:52.096026 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5440c7f5-a8d8-4bc2-8d88-1b4e23d9d9e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:52.109186 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5440c7f5-a8d8-4bc2-8d88-1b4e23d9d9e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.228489 May 26 16:54:52.109984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 102/184] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:51 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:52.131217 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-31044c19-67af-404d-81ad-cc37d31df6fe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:52.132500 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-31044c19-67af-404d-81ad-cc37d31df6fe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:52.142702 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-31044c19-67af-404d-81ad-cc37d31df6fe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:52.143448 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-31044c19-67af-404d-81ad-cc37d31df6fe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:52.144287 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-31044c19-67af-404d-81ad-cc37d31df6fe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:52.144736 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-31044c19-67af-404d-81ad-cc37d31df6fe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:52.310000 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-31044c19-67af-404d-81ad-cc37d31df6fe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:52.326272 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-31044c19-67af-404d-81ad-cc37d31df6fe tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1555 microversion: 2.1 time: 0.199441 May 26 16:54:52.341526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 83/185] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:52 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1555 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:53.136726 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-25d4d9a7-6b15-4076-9660-616ade860d35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:53.142272 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-25d4d9a7-6b15-4076-9660-616ade860d35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:53.153494 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-25d4d9a7-6b15-4076-9660-616ade860d35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:53.153494 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-25d4d9a7-6b15-4076-9660-616ade860d35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:53.153494 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-25d4d9a7-6b15-4076-9660-616ade860d35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:53.153494 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-25d4d9a7-6b15-4076-9660-616ade860d35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:53.318476 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-25d4d9a7-6b15-4076-9660-616ade860d35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:53.329035 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-25d4d9a7-6b15-4076-9660-616ade860d35 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.198025 May 26 16:54:53.334088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 103/186] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:53 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:53.359846 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-712f5241-6fa5-425b-a356-0311b648ec26 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:53.361048 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-712f5241-6fa5-425b-a356-0311b648ec26 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:53.370559 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-712f5241-6fa5-425b-a356-0311b648ec26 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:53.371413 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-712f5241-6fa5-425b-a356-0311b648ec26 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:53.373156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-712f5241-6fa5-425b-a356-0311b648ec26 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:53.373886 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-712f5241-6fa5-425b-a356-0311b648ec26 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:53.480197 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-49ad1662-77a3-4858-b810-bf983bba9bd7 req-aaac4fa9-61c0-4b78-9aad-a1e2a8e9a5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd6396b4-ab96-4ef1-86da-ced71936a336", "name": "network-vif-deleted", "tag": "461bedf8-343c-4769-a3de-3519954e0aa0"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:54:53.497186 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-49ad1662-77a3-4858-b810-bf983bba9bd7 req-aaac4fa9-61c0-4b78-9aad-a1e2a8e9a5e6 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:53.498382 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-49ad1662-77a3-4858-b810-bf983bba9bd7 req-aaac4fa9-61c0-4b78-9aad-a1e2a8e9a5e6 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:53.533591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-49ad1662-77a3-4858-b810-bf983bba9bd7 req-aaac4fa9-61c0-4b78-9aad-a1e2a8e9a5e6 service nova] Creating event network-vif-deleted:461bedf8-343c-4769-a3de-3519954e0aa0 for instance dd6396b4-ab96-4ef1-86da-ced71936a336 on hv-cinder-83607 May 26 16:54:53.537693 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-712f5241-6fa5-425b-a356-0311b648ec26 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:53.544526 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-49ad1662-77a3-4858-b810-bf983bba9bd7 req-aaac4fa9-61c0-4b78-9aad-a1e2a8e9a5e6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071271 May 26 16:54:53.546271 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 104/187] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:54:53.552258 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-712f5241-6fa5-425b-a356-0311b648ec26 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1513 microversion: 2.1 time: 0.198468 May 26 16:54:53.552258 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 84/188] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:53 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1513 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:54.350001 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-cf6a81dc-46d2-462a-a95c-b374a72befb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:54.350699 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-cf6a81dc-46d2-462a-a95c-b374a72befb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:54.357680 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cf6a81dc-46d2-462a-a95c-b374a72befb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:54.363855 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cf6a81dc-46d2-462a-a95c-b374a72befb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:54.363855 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cf6a81dc-46d2-462a-a95c-b374a72befb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:54.363855 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cf6a81dc-46d2-462a-a95c-b374a72befb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:54.494480 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-cf6a81dc-46d2-462a-a95c-b374a72befb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:54.503976 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-cf6a81dc-46d2-462a-a95c-b374a72befb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.158443 May 26 16:54:54.504564 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 105/189] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:54 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:54.569109 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1bc07247-c89e-41ed-bd03-c9c82e938f2f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:54.569790 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1bc07247-c89e-41ed-bd03-c9c82e938f2f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:54.576545 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1bc07247-c89e-41ed-bd03-c9c82e938f2f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:54.576989 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1bc07247-c89e-41ed-bd03-c9c82e938f2f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:54.577795 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1bc07247-c89e-41ed-bd03-c9c82e938f2f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:54.578233 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1bc07247-c89e-41ed-bd03-c9c82e938f2f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:54.645237 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1bc07247-c89e-41ed-bd03-c9c82e938f2f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:54.648345 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:54.659082 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1bc07247-c89e-41ed-bd03-c9c82e938f2f tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1346 microversion: 2.1 time: 0.093312 May 26 16:54:54.668913 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 85/190] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:54 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:55.520269 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8cf9f2a0-8f1c-4c33-8ef8-075b4ed4bd8e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:55.520876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8cf9f2a0-8f1c-4c33-8ef8-075b4ed4bd8e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:55.527458 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8cf9f2a0-8f1c-4c33-8ef8-075b4ed4bd8e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:55.527994 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8cf9f2a0-8f1c-4c33-8ef8-075b4ed4bd8e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:55.528704 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8cf9f2a0-8f1c-4c33-8ef8-075b4ed4bd8e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:55.529140 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8cf9f2a0-8f1c-4c33-8ef8-075b4ed4bd8e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:55.684379 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-52c78596-44aa-4e1c-ac7f-45993d6f5fe5 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:55.685138 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-52c78596-44aa-4e1c-ac7f-45993d6f5fe5 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:55.692357 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-52c78596-44aa-4e1c-ac7f-45993d6f5fe5 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:55.692809 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-52c78596-44aa-4e1c-ac7f-45993d6f5fe5 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:55.693698 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-52c78596-44aa-4e1c-ac7f-45993d6f5fe5 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:55.694141 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-52c78596-44aa-4e1c-ac7f-45993d6f5fe5 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:55.759133 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8cf9f2a0-8f1c-4c33-8ef8-075b4ed4bd8e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:55.767281 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8cf9f2a0-8f1c-4c33-8ef8-075b4ed4bd8e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.250710 May 26 16:54:55.768650 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 106/191] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:55 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:55.780527 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-52c78596-44aa-4e1c-ac7f-45993d6f5fe5 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:55.788687 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-52c78596-44aa-4e1c-ac7f-45993d6f5fe5 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1346 microversion: 2.1 time: 0.111939 May 26 16:54:55.789293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 86/192] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:55 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:56.786150 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9f1f4446-8e74-4ad9-87b4-42b5964fdbf5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:56.786703 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9f1f4446-8e74-4ad9-87b4-42b5964fdbf5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:56.793165 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9f1f4446-8e74-4ad9-87b4-42b5964fdbf5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:56.793682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9f1f4446-8e74-4ad9-87b4-42b5964fdbf5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:56.794462 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9f1f4446-8e74-4ad9-87b4-42b5964fdbf5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:56.794903 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9f1f4446-8e74-4ad9-87b4-42b5964fdbf5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:56.812453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fc81c242-0292-4601-a33b-e5c5548c3ff1 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:56.813228 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fc81c242-0292-4601-a33b-e5c5548c3ff1 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:56.821454 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fc81c242-0292-4601-a33b-e5c5548c3ff1 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:56.822017 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fc81c242-0292-4601-a33b-e5c5548c3ff1 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:56.822837 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fc81c242-0292-4601-a33b-e5c5548c3ff1 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:56.823280 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fc81c242-0292-4601-a33b-e5c5548c3ff1 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:56.922072 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-fc81c242-0292-4601-a33b-e5c5548c3ff1 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:56.945123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fc81c242-0292-4601-a33b-e5c5548c3ff1 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1346 microversion: 2.1 time: 0.136401 May 26 16:54:56.946609 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 87/193] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:56 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:56.979344 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9f1f4446-8e74-4ad9-87b4-42b5964fdbf5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:56.987290 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9f1f4446-8e74-4ad9-87b4-42b5964fdbf5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.205176 May 26 16:54:56.988842 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 107/194] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:56 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:57.966469 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-08f615b7-28f6-4d43-9d91-b8dd76f2071a tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:57.966469 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-08f615b7-28f6-4d43-9d91-b8dd76f2071a tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:57.971479 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-08f615b7-28f6-4d43-9d91-b8dd76f2071a tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:57.971940 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-08f615b7-28f6-4d43-9d91-b8dd76f2071a tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:57.972715 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-08f615b7-28f6-4d43-9d91-b8dd76f2071a tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:57.973316 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-08f615b7-28f6-4d43-9d91-b8dd76f2071a tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:58.007134 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-d53e7c8a-32f5-4a5f-a3b5-34bce597b874 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:58.009008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-d53e7c8a-32f5-4a5f-a3b5-34bce597b874 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:58.015829 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d53e7c8a-32f5-4a5f-a3b5-34bce597b874 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:58.016577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d53e7c8a-32f5-4a5f-a3b5-34bce597b874 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:58.018385 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d53e7c8a-32f5-4a5f-a3b5-34bce597b874 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:58.018385 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d53e7c8a-32f5-4a5f-a3b5-34bce597b874 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:58.046737 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-08f615b7-28f6-4d43-9d91-b8dd76f2071a tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e17514d68a274a0dbe606bb8db60c747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '187d77d887774bbc82b249a64f335d59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:58.056617 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-08f615b7-28f6-4d43-9d91-b8dd76f2071a tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 200 len: 1346 microversion: 2.1 time: 0.097563 May 26 16:54:58.057220 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 88/195] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:57 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 1346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:54:58.177800 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d53e7c8a-32f5-4a5f-a3b5-34bce597b874 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:58.190860 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-d53e7c8a-32f5-4a5f-a3b5-34bce597b874 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.183599 May 26 16:54:58.190860 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 108/196] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:58 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:54:59.075374 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b7505d9e-0c75-4479-a474-7e8832b82764 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:59.077662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b7505d9e-0c75-4479-a474-7e8832b82764 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:59.084924 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7505d9e-0c75-4479-a474-7e8832b82764 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:59.085430 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7505d9e-0c75-4479-a474-7e8832b82764 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:59.086244 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7505d9e-0c75-4479-a474-7e8832b82764 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:59.087185 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7505d9e-0c75-4479-a474-7e8832b82764 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:59.112401 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-b7505d9e-0c75-4479-a474-7e8832b82764 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] HTTP exception thrown: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b7505d9e-0c75-4479-a474-7e8832b82764 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Request method failure captured: May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 HTTP/1.1 May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7B7q1h9hGeXFunFLwCpGWeTZ8-GzGBEZLk9IbA3SlyTKa7iKkfst2mqP2rUoB-yvMYU0fmmeowQwn2W3AFF0kEENXEBQwe7gNf-k9fq4PJrv_oLp2aQiWx3QQhMrep_m9Ex1OOA3Qv2l9npHDqxqiPF7yuv2d9AqIY7mw-B81bqSbQ May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 187d77d887774bbc82b249a64f335d59 May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-DeleteServersTestJSON-293352731 May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 16:54:59.121624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 16:54:59.123131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/187d77d887774bbc82b249a64f335d59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/187d77d887774bbc82b249a64f335d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_187d77d887774bbc82b249a64f335d59", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/187d77d887774bbc82b249a64f335d59"}]}] May 26 16:54:59.123131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-DeleteServersTestJSON-293352731 May 26 16:54:59.123131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 187d77d887774bbc82b249a64f335d59 May 26 16:54:59.123131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-DeleteServersTestJSON-293352731 May 26 16:54:59.123131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-DeleteServersTestJSON-293352731-project May 26 16:54:59.123131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 16:54:59.123131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 16:54:59.123131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: e17514d68a274a0dbe606bb8db60c747 May 26 16:54:59.123131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-DeleteServersTestJSON-293352731-project May 26 16:54:59.123131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 16:54:59.123131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:54:59.123131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': 'dd6396b4-ab96-4ef1-86da-ced71936a336'} May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:54:59.123967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:54:59.128526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:54:59.129640 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b7505d9e-0c75-4479-a474-7e8832b82764 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Returning 404 to user: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:54:59.129640 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b7505d9e-0c75-4479-a474-7e8832b82764 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 404 len: 111 microversion: 2.1 time: 0.053008 May 26 16:54:59.129640 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 89/197] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:59 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 16:54:59.208706 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8b3dec22-0bd8-4d4f-90f3-fb2bc01dee54 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:59.209361 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8b3dec22-0bd8-4d4f-90f3-fb2bc01dee54 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:59.221316 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8b3dec22-0bd8-4d4f-90f3-fb2bc01dee54 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:59.222306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8b3dec22-0bd8-4d4f-90f3-fb2bc01dee54 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:59.226182 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8b3dec22-0bd8-4d4f-90f3-fb2bc01dee54 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:59.227604 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8b3dec22-0bd8-4d4f-90f3-fb2bc01dee54 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:59.265418 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bcdc3db9-b989-4b55-bd93-f6896bece628 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:54:59.266524 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bcdc3db9-b989-4b55-bd93-f6896bece628 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:54:59.282155 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bcdc3db9-b989-4b55-bd93-f6896bece628 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:59.283407 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bcdc3db9-b989-4b55-bd93-f6896bece628 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:59.286103 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bcdc3db9-b989-4b55-bd93-f6896bece628 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:54:59.286103 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bcdc3db9-b989-4b55-bd93-f6896bece628 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:54:59.308703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-bcdc3db9-b989-4b55-bd93-f6896bece628 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] HTTP exception thrown: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bcdc3db9-b989-4b55-bd93-f6896bece628 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Request method failure captured: May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336/os-volume_attachments HTTP/1.1 May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7B7q1h9hGeXFunFLwCpGWeTZ8-GzGBEZLk9IbA3SlyTKa7iKkfst2mqP2rUoB-yvMYU0fmmeowQwn2W3AFF0kEENXEBQwe7gNf-k9fq4PJrv_oLp2aQiWx3QQhMrep_m9Ex1OOA3Qv2l9npHDqxqiPF7yuv2d9AqIY7mw-B81bqSbQ May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 187d77d887774bbc82b249a64f335d59 May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-DeleteServersTestJSON-293352731 May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 16:54:59.313443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 16:54:59.315651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/187d77d887774bbc82b249a64f335d59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/187d77d887774bbc82b249a64f335d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_187d77d887774bbc82b249a64f335d59", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/187d77d887774bbc82b249a64f335d59"}]}] May 26 16:54:59.315651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-DeleteServersTestJSON-293352731 May 26 16:54:59.315651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 187d77d887774bbc82b249a64f335d59 May 26 16:54:59.315651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-DeleteServersTestJSON-293352731 May 26 16:54:59.315651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-DeleteServersTestJSON-293352731-project May 26 16:54:59.315651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 16:54:59.315651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 16:54:59.315651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: e17514d68a274a0dbe606bb8db60c747 May 26 16:54:59.315651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-DeleteServersTestJSON-293352731-project May 26 16:54:59.315651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 16:54:59.315651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:54:59.315651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'server_id': 'dd6396b4-ab96-4ef1-86da-ced71936a336'} May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:54:59.316603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:54:59.320056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:54:59.322662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bcdc3db9-b989-4b55-bd93-f6896bece628 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Returning 404 to user: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:54:59.322662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bcdc3db9-b989-4b55-bd93-f6896bece628 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.054833 May 26 16:54:59.322662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 90/198] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 16:54:59 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 16:54:59.515006 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8b3dec22-0bd8-4d4f-90f3-fb2bc01dee54 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:54:59.524936 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8b3dec22-0bd8-4d4f-90f3-fb2bc01dee54 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.319740 May 26 16:54:59.526116 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 109/199] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:54:59 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:00.543315 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f42a6977-27ac-4795-99af-68a7e20e307f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:00.544057 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f42a6977-27ac-4795-99af-68a7e20e307f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:00.551074 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f42a6977-27ac-4795-99af-68a7e20e307f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:00.551873 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f42a6977-27ac-4795-99af-68a7e20e307f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:00.552889 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f42a6977-27ac-4795-99af-68a7e20e307f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:00.553411 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f42a6977-27ac-4795-99af-68a7e20e307f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:00.711115 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f42a6977-27ac-4795-99af-68a7e20e307f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:00.725636 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f42a6977-27ac-4795-99af-68a7e20e307f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.185270 May 26 16:55:00.725636 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 91/200] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:00 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:00.964853 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-235a1b93-45d5-4634-aeb6-7d31a7191027 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:00.965636 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-235a1b93-45d5-4634-aeb6-7d31a7191027 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:00.972486 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-235a1b93-45d5-4634-aeb6-7d31a7191027 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:00.973399 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-235a1b93-45d5-4634-aeb6-7d31a7191027 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:00.974506 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-235a1b93-45d5-4634-aeb6-7d31a7191027 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:00.975156 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-235a1b93-45d5-4634-aeb6-7d31a7191027 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:00.995995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-235a1b93-45d5-4634-aeb6-7d31a7191027 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] HTTP exception thrown: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-235a1b93-45d5-4634-aeb6-7d31a7191027 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Request method failure captured: May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: DELETE /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 HTTP/1.1 May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7B7q1h9hGeXFunFLwCpGWeTZ8-GzGBEZLk9IbA3SlyTKa7iKkfst2mqP2rUoB-yvMYU0fmmeowQwn2W3AFF0kEENXEBQwe7gNf-k9fq4PJrv_oLp2aQiWx3QQhMrep_m9Ex1OOA3Qv2l9npHDqxqiPF7yuv2d9AqIY7mw-B81bqSbQ May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 187d77d887774bbc82b249a64f335d59 May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-DeleteServersTestJSON-293352731 May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:55:00.998289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:55:00.999513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/187d77d887774bbc82b249a64f335d59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/187d77d887774bbc82b249a64f335d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_187d77d887774bbc82b249a64f335d59", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/187d77d887774bbc82b249a64f335d59"}]}] May 26 16:55:00.999513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-DeleteServersTestJSON-293352731 May 26 16:55:00.999513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 187d77d887774bbc82b249a64f335d59 May 26 16:55:00.999513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-DeleteServersTestJSON-293352731 May 26 16:55:00.999513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-DeleteServersTestJSON-293352731-project May 26 16:55:00.999513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:55:00.999513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:55:00.999513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: e17514d68a274a0dbe606bb8db60c747 May 26 16:55:00.999513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-DeleteServersTestJSON-293352731-project May 26 16:55:00.999513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 16:55:00.999513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:55:00.999513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': 'dd6396b4-ab96-4ef1-86da-ced71936a336'} May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:55:01.000228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:55:01.001287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:55:01.002388 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-235a1b93-45d5-4634-aeb6-7d31a7191027 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Returning 404 to user: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:55:01.002388 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-235a1b93-45d5-4634-aeb6-7d31a7191027 tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 404 len: 111 microversion: 2.1 time: 0.039592 May 26 16:55:01.003570 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 110/201] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 16:55:00 2022] DELETE /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:55:01.012739 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1c1bd553-0839-47ee-8422-3f898adfecbc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:01.013632 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1c1bd553-0839-47ee-8422-3f898adfecbc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] [instance: dd6396b4-ab96-4ef1-86da-ced71936a336] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:01.019967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1c1bd553-0839-47ee-8422-3f898adfecbc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:01.020424 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1c1bd553-0839-47ee-8422-3f898adfecbc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:01.022547 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1c1bd553-0839-47ee-8422-3f898adfecbc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:01.022547 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1c1bd553-0839-47ee-8422-3f898adfecbc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:01.038613 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-1c1bd553-0839-47ee-8422-3f898adfecbc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] HTTP exception thrown: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1c1bd553-0839-47ee-8422-3f898adfecbc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Request method failure captured: May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 HTTP/1.1 May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7B7q1h9hGeXFunFLwCpGWeTZ8-GzGBEZLk9IbA3SlyTKa7iKkfst2mqP2rUoB-yvMYU0fmmeowQwn2W3AFF0kEENXEBQwe7gNf-k9fq4PJrv_oLp2aQiWx3QQhMrep_m9Ex1OOA3Qv2l9npHDqxqiPF7yuv2d9AqIY7mw-B81bqSbQ May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 187d77d887774bbc82b249a64f335d59 May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-DeleteServersTestJSON-293352731 May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 16:55:01.039999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 16:55:01.041329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/187d77d887774bbc82b249a64f335d59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/187d77d887774bbc82b249a64f335d59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_187d77d887774bbc82b249a64f335d59", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/187d77d887774bbc82b249a64f335d59"}]}] May 26 16:55:01.041329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-DeleteServersTestJSON-293352731 May 26 16:55:01.041329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 187d77d887774bbc82b249a64f335d59 May 26 16:55:01.041329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-DeleteServersTestJSON-293352731 May 26 16:55:01.041329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-DeleteServersTestJSON-293352731-project May 26 16:55:01.041329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 16:55:01.041329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 16:55:01.041329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: e17514d68a274a0dbe606bb8db60c747 May 26 16:55:01.041329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-DeleteServersTestJSON-293352731-project May 26 16:55:01.041329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 16:55:01.041329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:55:01.041329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': 'dd6396b4-ab96-4ef1-86da-ced71936a336'} May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:55:01.051758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. May 26 16:55:01.053061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:55:01.054079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1c1bd553-0839-47ee-8422-3f898adfecbc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] Returning 404 to user: Instance dd6396b4-ab96-4ef1-86da-ced71936a336 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:55:01.054079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1c1bd553-0839-47ee-8422-3f898adfecbc tempest-DeleteServersTestJSON-293352731 tempest-DeleteServersTestJSON-293352731-project] 10.222.0.48 "GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336" status: 404 len: 111 microversion: 2.1 time: 0.035149 May 26 16:55:01.054079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 92/202] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:01 2022] GET /compute/v2.1/servers/dd6396b4-ab96-4ef1-86da-ced71936a336 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:55:01.743969 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f023cd8b-a8e0-44eb-83f9-316af82b827c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:01.744594 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f023cd8b-a8e0-44eb-83f9-316af82b827c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:01.752719 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f023cd8b-a8e0-44eb-83f9-316af82b827c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:01.755897 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f023cd8b-a8e0-44eb-83f9-316af82b827c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:01.757620 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f023cd8b-a8e0-44eb-83f9-316af82b827c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:01.757620 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f023cd8b-a8e0-44eb-83f9-316af82b827c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:01.909801 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f023cd8b-a8e0-44eb-83f9-316af82b827c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:01.918145 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f023cd8b-a8e0-44eb-83f9-316af82b827c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.179729 May 26 16:55:01.918732 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 111/203] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:01 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:02.940741 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bb13f8a6-df77-448d-a788-5c27ae15c4e1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:02.942131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bb13f8a6-df77-448d-a788-5c27ae15c4e1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:02.956302 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bb13f8a6-df77-448d-a788-5c27ae15c4e1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:02.957240 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bb13f8a6-df77-448d-a788-5c27ae15c4e1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:02.958877 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bb13f8a6-df77-448d-a788-5c27ae15c4e1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:02.959802 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bb13f8a6-df77-448d-a788-5c27ae15c4e1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:03.191070 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bb13f8a6-df77-448d-a788-5c27ae15c4e1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:03.201553 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bb13f8a6-df77-448d-a788-5c27ae15c4e1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.269264 May 26 16:55:03.202306 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 93/204] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:02 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:04.221942 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-540e5178-7d9a-4a0a-bf07-ed1dd078a4c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:04.222975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-540e5178-7d9a-4a0a-bf07-ed1dd078a4c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:04.238714 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-540e5178-7d9a-4a0a-bf07-ed1dd078a4c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:04.239468 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-540e5178-7d9a-4a0a-bf07-ed1dd078a4c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:04.240752 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-540e5178-7d9a-4a0a-bf07-ed1dd078a4c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:04.241493 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-540e5178-7d9a-4a0a-bf07-ed1dd078a4c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:04.429972 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-540e5178-7d9a-4a0a-bf07-ed1dd078a4c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:04.439516 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-540e5178-7d9a-4a0a-bf07-ed1dd078a4c9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.223004 May 26 16:55:04.440118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 112/205] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:04 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:05.458699 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-008a275b-c188-4b91-b149-3dd0f8778e58 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:05.459357 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-008a275b-c188-4b91-b149-3dd0f8778e58 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:05.466876 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-008a275b-c188-4b91-b149-3dd0f8778e58 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:05.467435 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-008a275b-c188-4b91-b149-3dd0f8778e58 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:05.468282 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-008a275b-c188-4b91-b149-3dd0f8778e58 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:05.468795 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-008a275b-c188-4b91-b149-3dd0f8778e58 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:05.680654 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-008a275b-c188-4b91-b149-3dd0f8778e58 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:05.692297 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-008a275b-c188-4b91-b149-3dd0f8778e58 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.235896 May 26 16:55:05.692297 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 94/206] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:05 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:06.725168 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-0018b8ca-43c5-4ef7-81c9-cf2a542bcfef tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:06.726409 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-0018b8ca-43c5-4ef7-81c9-cf2a542bcfef tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:06.739146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0018b8ca-43c5-4ef7-81c9-cf2a542bcfef tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:06.740749 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0018b8ca-43c5-4ef7-81c9-cf2a542bcfef tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:06.742467 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0018b8ca-43c5-4ef7-81c9-cf2a542bcfef tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:06.743709 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0018b8ca-43c5-4ef7-81c9-cf2a542bcfef tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:07.090174 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-0018b8ca-43c5-4ef7-81c9-cf2a542bcfef tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:07.100593 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-0018b8ca-43c5-4ef7-81c9-cf2a542bcfef tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1522 microversion: 2.1 time: 0.389392 May 26 16:55:07.101220 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 113/207] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:06 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1522 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:08.142569 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6943ad64-3865-4cba-8635-4f68f1976f92 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:08.144245 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6943ad64-3865-4cba-8635-4f68f1976f92 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:08.183753 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6943ad64-3865-4cba-8635-4f68f1976f92 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:08.184114 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6943ad64-3865-4cba-8635-4f68f1976f92 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:08.184943 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6943ad64-3865-4cba-8635-4f68f1976f92 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:08.185428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6943ad64-3865-4cba-8635-4f68f1976f92 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:08.431175 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6943ad64-3865-4cba-8635-4f68f1976f92 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:08.443364 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6943ad64-3865-4cba-8635-4f68f1976f92 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1502 microversion: 2.1 time: 0.311863 May 26 16:55:08.444348 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 95/208] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:08 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1502 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:08.469718 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-73952b2b-1229-4443-9a75-d7a00a0dc292 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:08.471810 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-73952b2b-1229-4443-9a75-d7a00a0dc292 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:08.487637 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-73952b2b-1229-4443-9a75-d7a00a0dc292 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:08.488111 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-73952b2b-1229-4443-9a75-d7a00a0dc292 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:08.489016 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-73952b2b-1229-4443-9a75-d7a00a0dc292 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:08.506994 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-73952b2b-1229-4443-9a75-d7a00a0dc292 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:08.533729 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=100 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:08.666167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-73952b2b-1229-4443-9a75-d7a00a0dc292 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:08.674196 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-73952b2b-1229-4443-9a75-d7a00a0dc292 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1516 microversion: 2.1 time: 0.215837 May 26 16:55:08.674782 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 114/209] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:08 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1516 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:13.086968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1d154e6f-1964-4f42-bed0-09851125d087 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:13.089126 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1d154e6f-1964-4f42-bed0-09851125d087 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:13.098233 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d154e6f-1964-4f42-bed0-09851125d087 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:13.098747 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d154e6f-1964-4f42-bed0-09851125d087 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:13.100080 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d154e6f-1964-4f42-bed0-09851125d087 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:13.114444 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d154e6f-1964-4f42-bed0-09851125d087 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:13.193741 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-1d154e6f-1964-4f42-bed0-09851125d087 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lazy-loading 'flavor' on Instance uuid 3ecc34c3-8a11-43df-b56d-0996916a0187 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:55:13.701208 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1d154e6f-1964-4f42-bed0-09851125d087 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "POST /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187/action" status: 200 len: 32 microversion: 2.1 time: 0.621971 May 26 16:55:13.710593 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 96/210] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 26 16:55:13 2022] POST /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187/action => generated 32 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 16:55:13.722683 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b6a4520f-b1ad-4791-97e8-7498ce1ddc2f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:13.722683 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b6a4520f-b1ad-4791-97e8-7498ce1ddc2f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:13.737735 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b6a4520f-b1ad-4791-97e8-7498ce1ddc2f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:13.738473 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b6a4520f-b1ad-4791-97e8-7498ce1ddc2f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:13.739459 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b6a4520f-b1ad-4791-97e8-7498ce1ddc2f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:13.739959 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b6a4520f-b1ad-4791-97e8-7498ce1ddc2f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:13.932376 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b6a4520f-b1ad-4791-97e8-7498ce1ddc2f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:13.943335 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b6a4520f-b1ad-4791-97e8-7498ce1ddc2f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.231113 May 26 16:55:13.944844 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 115/211] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:13 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:14.967242 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0ab746ad-16f1-4cbf-b407-470e17eb68be tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:14.969371 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0ab746ad-16f1-4cbf-b407-470e17eb68be tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:14.986406 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0ab746ad-16f1-4cbf-b407-470e17eb68be tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:14.987655 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0ab746ad-16f1-4cbf-b407-470e17eb68be tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:14.988667 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0ab746ad-16f1-4cbf-b407-470e17eb68be tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:14.989349 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0ab746ad-16f1-4cbf-b407-470e17eb68be tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:15.210786 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0ab746ad-16f1-4cbf-b407-470e17eb68be tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:15.224886 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0ab746ad-16f1-4cbf-b407-470e17eb68be tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.266810 May 26 16:55:15.225633 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 97/212] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:14 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:15.601016 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a20fd63f-d4f9-42e7-9d95-33dcf977dea6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Action: 'create', calling method: .version_select at 0x7fbe806d2700>, body: {"keypair": {"name": "tempest-keypair-34356173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjP3a5qe8571DMLj56R609aRJkl4tw78SMHn8xYUyMtJQg1h17MtmWpSm8aPYoHUE8sbAC5JDm8DGj00+SALVY4DD8i/zWfE1mOMwXlYUmCPygeU7Muzmzlw4Asc/AXEQ=="}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:15.624018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-a20fd63f-d4f9-42e7-9d95-33dcf977dea6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'key_pairs'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:55:15.631165 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-a20fd63f-d4f9-42e7-9d95-33dcf977dea6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for user 1551f28754a64d1d9010ed90b67c5dc4 and project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'key_pairs'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:55:15.738227 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a20fd63f-d4f9-42e7-9d95-33dcf977dea6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.368828 May 26 16:55:15.738843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 116/213] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 26 16:55:15 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:16.249603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4db89176-4607-4945-9a0c-0d463dea6139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:16.250430 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4db89176-4607-4945-9a0c-0d463dea6139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:16.260194 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4db89176-4607-4945-9a0c-0d463dea6139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:16.260712 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4db89176-4607-4945-9a0c-0d463dea6139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:16.261742 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4db89176-4607-4945-9a0c-0d463dea6139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:16.262187 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4db89176-4607-4945-9a0c-0d463dea6139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:16.483334 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4db89176-4607-4945-9a0c-0d463dea6139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:16.508739 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4db89176-4607-4945-9a0c-0d463dea6139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.263501 May 26 16:55:16.512921 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 98/214] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:16 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:17.542860 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8817006f-7421-4cb4-8ea0-9fec6652b77c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:17.543764 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8817006f-7421-4cb4-8ea0-9fec6652b77c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:17.558022 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8817006f-7421-4cb4-8ea0-9fec6652b77c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:17.558737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8817006f-7421-4cb4-8ea0-9fec6652b77c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:17.559994 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8817006f-7421-4cb4-8ea0-9fec6652b77c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:17.560745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8817006f-7421-4cb4-8ea0-9fec6652b77c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:17.754262 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8817006f-7421-4cb4-8ea0-9fec6652b77c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:17.770380 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8817006f-7421-4cb4-8ea0-9fec6652b77c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.234779 May 26 16:55:17.772247 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 117/215] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:17 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:18.788205 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e4e6e176-ba80-4fd8-baec-16f7326e0d7d tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:18.788968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e4e6e176-ba80-4fd8-baec-16f7326e0d7d tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:18.796696 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4e6e176-ba80-4fd8-baec-16f7326e0d7d tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:18.797146 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4e6e176-ba80-4fd8-baec-16f7326e0d7d tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:18.798005 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4e6e176-ba80-4fd8-baec-16f7326e0d7d tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:18.798446 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4e6e176-ba80-4fd8-baec-16f7326e0d7d tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:18.872999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1378463009", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f04a253f-94d5-469e-a169-e4789fc9cd70"}], "security_groups": [{"name": "tempest-securitygroup--614505062"}], "key_name": "tempest-keypair-34356173", "user_data": "}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:18.889738 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:18.954001 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e4e6e176-ba80-4fd8-baec-16f7326e0d7d tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:18.967898 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e4e6e176-ba80-4fd8-baec-16f7326e0d7d tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.183632 May 26 16:55:18.970017 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 99/216] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:18 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:19.013573 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.network.neutron [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] validate_networks() for [('f04a253f-94d5-469e-a169-e4789fc9cd70', None, None, None, None, None)] {{(pid=124836) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:55:19.441011 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Flavor limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:55:19.441601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Image limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:55:19.442084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Flavor pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:55:19.442501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Image pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:55:19.442917 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:55:19.453034 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:19.453673 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:19.454529 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:19.454971 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:19.473512 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:55:19.478811 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for user 1551f28754a64d1d9010ed90b67c5dc4 and project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:55:19.494108 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Going to run 1 instances... {{(pid=124836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:55:19.496782 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:55:19.646361 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5d0fbab0-c132-4bc3-9341-d84db89b1913 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.778096 May 26 16:55:19.647293 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 118/217] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 16:55:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 16:55:19.657195 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f2d75b82-d6f4-4d70-89d4-9331ca13c08c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:19.658333 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f2d75b82-d6f4-4d70-89d4-9331ca13c08c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:19.735488 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f2d75b82-d6f4-4d70-89d4-9331ca13c08c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:19.744631 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f2d75b82-d6f4-4d70-89d4-9331ca13c08c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1240 microversion: 2.1 time: 0.090985 May 26 16:55:19.744935 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 100/218] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:19 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1240 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:19.991894 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7fdb95f0-f583-4d01-8a7a-13ed7058e446 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:19.993486 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7fdb95f0-f583-4d01-8a7a-13ed7058e446 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:20.002101 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7fdb95f0-f583-4d01-8a7a-13ed7058e446 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:20.006564 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7fdb95f0-f583-4d01-8a7a-13ed7058e446 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:20.006564 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7fdb95f0-f583-4d01-8a7a-13ed7058e446 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:20.006564 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7fdb95f0-f583-4d01-8a7a-13ed7058e446 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:20.229046 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7fdb95f0-f583-4d01-8a7a-13ed7058e446 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:20.263052 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7fdb95f0-f583-4d01-8a7a-13ed7058e446 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.278277 May 26 16:55:20.266643 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 119/219] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:19 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:20.762132 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0f1dbe3e-68f4-4eb4-91d4-d1481406c13f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:20.762705 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0f1dbe3e-68f4-4eb4-91d4-d1481406c13f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:20.818619 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0f1dbe3e-68f4-4eb4-91d4-d1481406c13f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:20.826104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0f1dbe3e-68f4-4eb4-91d4-d1481406c13f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1240 microversion: 2.1 time: 0.068140 May 26 16:55:20.826695 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 101/220] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:20 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:21.290796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-0aa3c538-b5ca-4f82-a766-457d07939575 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:21.291472 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-0aa3c538-b5ca-4f82-a766-457d07939575 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:21.299512 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0aa3c538-b5ca-4f82-a766-457d07939575 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:21.299968 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0aa3c538-b5ca-4f82-a766-457d07939575 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:21.300744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0aa3c538-b5ca-4f82-a766-457d07939575 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:21.301178 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0aa3c538-b5ca-4f82-a766-457d07939575 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:21.489749 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-0aa3c538-b5ca-4f82-a766-457d07939575 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:21.501121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-0aa3c538-b5ca-4f82-a766-457d07939575 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.214178 May 26 16:55:21.502997 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 120/221] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:21 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:21.844564 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4be07c4a-9c9a-4e1e-8c8b-f39668c697f1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:21.845144 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4be07c4a-9c9a-4e1e-8c8b-f39668c697f1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:21.847841 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=44 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:21.856379 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4be07c4a-9c9a-4e1e-8c8b-f39668c697f1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:21.856826 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4be07c4a-9c9a-4e1e-8c8b-f39668c697f1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:21.857640 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4be07c4a-9c9a-4e1e-8c8b-f39668c697f1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:21.858081 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4be07c4a-9c9a-4e1e-8c8b-f39668c697f1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:21.925009 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4be07c4a-9c9a-4e1e-8c8b-f39668c697f1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:21.936382 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4be07c4a-9c9a-4e1e-8c8b-f39668c697f1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1292 microversion: 2.1 time: 0.095611 May 26 16:55:21.937026 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 102/222] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:21 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:22.520452 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-0b13f9fa-620c-4efd-8a9c-ae9eaf914a7b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:22.521074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-0b13f9fa-620c-4efd-8a9c-ae9eaf914a7b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:22.528234 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0b13f9fa-620c-4efd-8a9c-ae9eaf914a7b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:22.528968 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0b13f9fa-620c-4efd-8a9c-ae9eaf914a7b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:22.529793 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0b13f9fa-620c-4efd-8a9c-ae9eaf914a7b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:22.530224 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0b13f9fa-620c-4efd-8a9c-ae9eaf914a7b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:22.717019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-0b13f9fa-620c-4efd-8a9c-ae9eaf914a7b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:22.726651 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-0b13f9fa-620c-4efd-8a9c-ae9eaf914a7b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.210187 May 26 16:55:22.737531 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 121/223] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:22 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:22.955707 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-86f51a17-e2cc-43f9-9b0b-542bb1f33346 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:22.956856 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-86f51a17-e2cc-43f9-9b0b-542bb1f33346 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:22.964570 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86f51a17-e2cc-43f9-9b0b-542bb1f33346 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:22.965155 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86f51a17-e2cc-43f9-9b0b-542bb1f33346 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:22.966022 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86f51a17-e2cc-43f9-9b0b-542bb1f33346 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:22.966536 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86f51a17-e2cc-43f9-9b0b-542bb1f33346 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:23.047740 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-86f51a17-e2cc-43f9-9b0b-542bb1f33346 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:23.070059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-86f51a17-e2cc-43f9-9b0b-542bb1f33346 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1298 microversion: 2.1 time: 0.118216 May 26 16:55:23.071330 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 103/224] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:22 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:23.746914 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e7110482-4216-4221-9dcf-959857398316 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:23.747606 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e7110482-4216-4221-9dcf-959857398316 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:23.754182 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e7110482-4216-4221-9dcf-959857398316 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:23.754894 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e7110482-4216-4221-9dcf-959857398316 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:23.755742 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e7110482-4216-4221-9dcf-959857398316 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:23.756429 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e7110482-4216-4221-9dcf-959857398316 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:23.953766 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e7110482-4216-4221-9dcf-959857398316 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:23.963126 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e7110482-4216-4221-9dcf-959857398316 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.220905 May 26 16:55:23.963725 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 122/225] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:23 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:24.094938 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7e1ac6e3-ec22-4cc1-94bf-29dbd80cc71f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:24.096549 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7e1ac6e3-ec22-4cc1-94bf-29dbd80cc71f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:24.104622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7e1ac6e3-ec22-4cc1-94bf-29dbd80cc71f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:24.105083 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7e1ac6e3-ec22-4cc1-94bf-29dbd80cc71f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:24.105897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7e1ac6e3-ec22-4cc1-94bf-29dbd80cc71f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:24.106373 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7e1ac6e3-ec22-4cc1-94bf-29dbd80cc71f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:24.123777 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:24.272822 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7e1ac6e3-ec22-4cc1-94bf-29dbd80cc71f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:24.283053 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7e1ac6e3-ec22-4cc1-94bf-29dbd80cc71f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1365 microversion: 2.1 time: 0.192435 May 26 16:55:24.294152 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 104/226] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:24 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:24.748881 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-217bcbb5-e396-43b6-b56c-b57b14707b1c req-f31a408c-e828-4119-895e-c826a606584c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922fbe1c-0632-41ec-b652-d4e1c457d234", "tag": "aa42d105-247d-49cd-9b56-b9f75a4b66eb"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:24.764068 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-217bcbb5-e396-43b6-b56c-b57b14707b1c req-f31a408c-e828-4119-895e-c826a606584c service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:24.764539 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-217bcbb5-e396-43b6-b56c-b57b14707b1c req-f31a408c-e828-4119-895e-c826a606584c service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:24.780432 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-217bcbb5-e396-43b6-b56c-b57b14707b1c req-f31a408c-e828-4119-895e-c826a606584c service nova] Creating event network-changed:aa42d105-247d-49cd-9b56-b9f75a4b66eb for instance 922fbe1c-0632-41ec-b652-d4e1c457d234 on hv-cinder-83607 May 26 16:55:24.785666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-217bcbb5-e396-43b6-b56c-b57b14707b1c req-f31a408c-e828-4119-895e-c826a606584c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040482 May 26 16:55:24.789886 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 123/227] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:25.000021 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-58f367c7-555f-4841-b016-c7dbfdd9e602 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:25.001534 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-58f367c7-555f-4841-b016-c7dbfdd9e602 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:25.016164 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58f367c7-555f-4841-b016-c7dbfdd9e602 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:25.016728 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58f367c7-555f-4841-b016-c7dbfdd9e602 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:25.018473 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58f367c7-555f-4841-b016-c7dbfdd9e602 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:25.019287 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58f367c7-555f-4841-b016-c7dbfdd9e602 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:25.198829 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-58f367c7-555f-4841-b016-c7dbfdd9e602 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:25.208018 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-58f367c7-555f-4841-b016-c7dbfdd9e602 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.224772 May 26 16:55:25.208818 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 105/228] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:24 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:25.302695 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1625d936-1b8b-4612-913d-ee9c5766d095 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:25.303401 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1625d936-1b8b-4612-913d-ee9c5766d095 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:25.310434 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1625d936-1b8b-4612-913d-ee9c5766d095 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:25.310956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1625d936-1b8b-4612-913d-ee9c5766d095 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:25.311756 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1625d936-1b8b-4612-913d-ee9c5766d095 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:25.312202 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1625d936-1b8b-4612-913d-ee9c5766d095 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:25.462544 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1625d936-1b8b-4612-913d-ee9c5766d095 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:25.479484 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-1625d936-1b8b-4612-913d-ee9c5766d095 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1365 microversion: 2.1 time: 0.180708 May 26 16:55:25.480646 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 124/229] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:25 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:26.227096 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c71b4bac-c8f1-4193-8e90-0e15ebd46d18 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:26.228411 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c71b4bac-c8f1-4193-8e90-0e15ebd46d18 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:26.235847 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c71b4bac-c8f1-4193-8e90-0e15ebd46d18 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:26.236604 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c71b4bac-c8f1-4193-8e90-0e15ebd46d18 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:26.237616 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c71b4bac-c8f1-4193-8e90-0e15ebd46d18 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:26.238061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c71b4bac-c8f1-4193-8e90-0e15ebd46d18 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:26.460344 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c71b4bac-c8f1-4193-8e90-0e15ebd46d18 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:26.469588 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c71b4bac-c8f1-4193-8e90-0e15ebd46d18 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.247327 May 26 16:55:26.470188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 106/230] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:26 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:26.521633 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-49ed66b8-f142-4d1a-a73d-40c8dcc6fcad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:26.522314 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-49ed66b8-f142-4d1a-a73d-40c8dcc6fcad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:26.533490 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-49ed66b8-f142-4d1a-a73d-40c8dcc6fcad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:26.534794 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-49ed66b8-f142-4d1a-a73d-40c8dcc6fcad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:26.536211 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-49ed66b8-f142-4d1a-a73d-40c8dcc6fcad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:26.536856 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-49ed66b8-f142-4d1a-a73d-40c8dcc6fcad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:26.727332 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-49ed66b8-f142-4d1a-a73d-40c8dcc6fcad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:26.732897 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-49ed66b8-f142-4d1a-a73d-40c8dcc6fcad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1365 microversion: 2.1 time: 0.232031 May 26 16:55:26.733520 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 125/231] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:26 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:27.491663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0f963f55-1a2e-4259-aad2-aa075c1568d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:27.493983 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0f963f55-1a2e-4259-aad2-aa075c1568d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:27.507459 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0f963f55-1a2e-4259-aad2-aa075c1568d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:27.513585 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0f963f55-1a2e-4259-aad2-aa075c1568d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:27.513585 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0f963f55-1a2e-4259-aad2-aa075c1568d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:27.513585 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0f963f55-1a2e-4259-aad2-aa075c1568d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:27.694550 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0f963f55-1a2e-4259-aad2-aa075c1568d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:27.704099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0f963f55-1a2e-4259-aad2-aa075c1568d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.219046 May 26 16:55:27.705035 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 107/232] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:27 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:27.754586 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6e97b276-71f2-401a-b750-baf6d8bc02cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:27.756034 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6e97b276-71f2-401a-b750-baf6d8bc02cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:27.776799 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6e97b276-71f2-401a-b750-baf6d8bc02cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:27.792086 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6e97b276-71f2-401a-b750-baf6d8bc02cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:27.799444 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6e97b276-71f2-401a-b750-baf6d8bc02cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:27.801726 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6e97b276-71f2-401a-b750-baf6d8bc02cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:27.975233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6e97b276-71f2-401a-b750-baf6d8bc02cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:27.992990 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6e97b276-71f2-401a-b750-baf6d8bc02cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1365 microversion: 2.1 time: 0.240309 May 26 16:55:27.995942 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 126/233] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:27 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:28.730857 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-42647b15-ac90-42ac-b3c7-ff9ad0b3b614 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:28.731641 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-42647b15-ac90-42ac-b3c7-ff9ad0b3b614 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:28.743993 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42647b15-ac90-42ac-b3c7-ff9ad0b3b614 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:28.744770 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42647b15-ac90-42ac-b3c7-ff9ad0b3b614 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:28.746053 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42647b15-ac90-42ac-b3c7-ff9ad0b3b614 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:28.746749 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42647b15-ac90-42ac-b3c7-ff9ad0b3b614 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:28.965675 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-42647b15-ac90-42ac-b3c7-ff9ad0b3b614 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:28.979098 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-42647b15-ac90-42ac-b3c7-ff9ad0b3b614 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.255956 May 26 16:55:28.985302 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 108/234] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:28 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:29.015783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-68725820-f977-46be-89c5-9c769a3821ff tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:29.016698 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-68725820-f977-46be-89c5-9c769a3821ff tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:29.040531 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-68725820-f977-46be-89c5-9c769a3821ff tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:29.040990 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-68725820-f977-46be-89c5-9c769a3821ff tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:29.041841 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-68725820-f977-46be-89c5-9c769a3821ff tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:29.048028 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-68725820-f977-46be-89c5-9c769a3821ff tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:29.342155 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-68725820-f977-46be-89c5-9c769a3821ff tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:29.356287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-68725820-f977-46be-89c5-9c769a3821ff tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1365 microversion: 2.1 time: 0.346524 May 26 16:55:29.357314 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 127/235] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:29 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:30.027949 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1309c9f9-008c-46c9-be91-f88b3f2c2448 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:30.028870 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1309c9f9-008c-46c9-be91-f88b3f2c2448 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:30.043353 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1309c9f9-008c-46c9-be91-f88b3f2c2448 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:30.043353 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1309c9f9-008c-46c9-be91-f88b3f2c2448 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:30.043353 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1309c9f9-008c-46c9-be91-f88b3f2c2448 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:30.043353 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1309c9f9-008c-46c9-be91-f88b3f2c2448 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:30.294405 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1309c9f9-008c-46c9-be91-f88b3f2c2448 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:30.303714 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1309c9f9-008c-46c9-be91-f88b3f2c2448 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.298661 May 26 16:55:30.304715 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 109/236] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:30 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:30.382504 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f4627252-3fd2-4319-9c69-dc3ca8ef0fd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:30.384784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f4627252-3fd2-4319-9c69-dc3ca8ef0fd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:30.398606 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:30.400235 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=10 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:30.405239 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f4627252-3fd2-4319-9c69-dc3ca8ef0fd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:30.406768 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f4627252-3fd2-4319-9c69-dc3ca8ef0fd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:30.409278 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f4627252-3fd2-4319-9c69-dc3ca8ef0fd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:30.410452 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f4627252-3fd2-4319-9c69-dc3ca8ef0fd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:30.727355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f4627252-3fd2-4319-9c69-dc3ca8ef0fd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:30.737470 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f4627252-3fd2-4319-9c69-dc3ca8ef0fd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1365 microversion: 2.1 time: 0.363524 May 26 16:55:30.739646 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 128/237] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:30 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1365 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:31.329767 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e2cb7f51-c54a-4acd-aadb-2a6aee18e1fd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:31.330736 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e2cb7f51-c54a-4acd-aadb-2a6aee18e1fd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:31.333007 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=4 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:31.340735 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2cb7f51-c54a-4acd-aadb-2a6aee18e1fd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:31.341501 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2cb7f51-c54a-4acd-aadb-2a6aee18e1fd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:31.342429 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2cb7f51-c54a-4acd-aadb-2a6aee18e1fd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:31.343002 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2cb7f51-c54a-4acd-aadb-2a6aee18e1fd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:31.547592 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e2cb7f51-c54a-4acd-aadb-2a6aee18e1fd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:31.566985 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e2cb7f51-c54a-4acd-aadb-2a6aee18e1fd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.241800 May 26 16:55:31.569612 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 110/238] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:31 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:31.761461 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-0baf41c8-b90e-4970-96ad-ff8226b4ffb6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:31.762578 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-0baf41c8-b90e-4970-96ad-ff8226b4ffb6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:31.782015 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0baf41c8-b90e-4970-96ad-ff8226b4ffb6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:31.782015 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0baf41c8-b90e-4970-96ad-ff8226b4ffb6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:31.782015 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0baf41c8-b90e-4970-96ad-ff8226b4ffb6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:31.782015 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0baf41c8-b90e-4970-96ad-ff8226b4ffb6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:31.971528 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-876881f4-054c-4bf1-88b3-e2a3d3972de2 req-e4ea0ed1-b5c4-4bb3-bb94-a36dca89d0ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922fbe1c-0632-41ec-b652-d4e1c457d234", "name": "network-vif-plugged", "status": "completed", "tag": "aa42d105-247d-49cd-9b56-b9f75a4b66eb"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:31.987587 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-876881f4-054c-4bf1-88b3-e2a3d3972de2 req-e4ea0ed1-b5c4-4bb3-bb94-a36dca89d0ce service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:31.988487 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-876881f4-054c-4bf1-88b3-e2a3d3972de2 req-e4ea0ed1-b5c4-4bb3-bb94-a36dca89d0ce service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:31.999249 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-0baf41c8-b90e-4970-96ad-ff8226b4ffb6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:32.004953 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-876881f4-054c-4bf1-88b3-e2a3d3972de2 req-e4ea0ed1-b5c4-4bb3-bb94-a36dca89d0ce service nova] Creating event network-vif-plugged:aa42d105-247d-49cd-9b56-b9f75a4b66eb for instance 922fbe1c-0632-41ec-b652-d4e1c457d234 on hv-cinder-83607 May 26 16:55:32.011565 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-876881f4-054c-4bf1-88b3-e2a3d3972de2 req-e4ea0ed1-b5c4-4bb3-bb94-a36dca89d0ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045104 May 26 16:55:32.013142 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 111/239] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:32.017298 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-0baf41c8-b90e-4970-96ad-ff8226b4ffb6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1365 microversion: 2.1 time: 0.262570 May 26 16:55:32.019030 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 129/240] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:31 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:32.593016 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-26562f73-5ce8-4f6d-9db8-b224d1807cb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:32.593757 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-26562f73-5ce8-4f6d-9db8-b224d1807cb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:32.601881 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26562f73-5ce8-4f6d-9db8-b224d1807cb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:32.602365 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26562f73-5ce8-4f6d-9db8-b224d1807cb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:32.603532 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26562f73-5ce8-4f6d-9db8-b224d1807cb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:32.604313 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-26562f73-5ce8-4f6d-9db8-b224d1807cb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:32.827783 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-26562f73-5ce8-4f6d-9db8-b224d1807cb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:32.837341 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-26562f73-5ce8-4f6d-9db8-b224d1807cb2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.253291 May 26 16:55:32.838224 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 112/241] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:32 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:33.040739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-06e37068-352e-4050-926d-6f3380bbee0c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:33.041666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-06e37068-352e-4050-926d-6f3380bbee0c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:33.050308 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-06e37068-352e-4050-926d-6f3380bbee0c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:33.050982 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-06e37068-352e-4050-926d-6f3380bbee0c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:33.052080 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-06e37068-352e-4050-926d-6f3380bbee0c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:33.052645 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-06e37068-352e-4050-926d-6f3380bbee0c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:33.259275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-06e37068-352e-4050-926d-6f3380bbee0c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:33.270962 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-06e37068-352e-4050-926d-6f3380bbee0c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1365 microversion: 2.1 time: 0.236107 May 26 16:55:33.284263 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 130/242] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:33 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:33.860996 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a00f4211-9d49-41ce-b669-0ad14471758c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:33.862328 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a00f4211-9d49-41ce-b669-0ad14471758c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:33.875114 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a00f4211-9d49-41ce-b669-0ad14471758c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:33.876239 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a00f4211-9d49-41ce-b669-0ad14471758c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:33.878653 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a00f4211-9d49-41ce-b669-0ad14471758c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:33.879679 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a00f4211-9d49-41ce-b669-0ad14471758c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:34.045206 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a00f4211-9d49-41ce-b669-0ad14471758c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:34.060131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a00f4211-9d49-41ce-b669-0ad14471758c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.208078 May 26 16:55:34.061131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 113/243] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:33 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:34.294816 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-515e543e-931f-4d31-9a9c-3bf184f2d5fe tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:34.296481 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-515e543e-931f-4d31-9a9c-3bf184f2d5fe tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:34.308999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-515e543e-931f-4d31-9a9c-3bf184f2d5fe tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:34.309227 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-515e543e-931f-4d31-9a9c-3bf184f2d5fe tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:34.309955 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-515e543e-931f-4d31-9a9c-3bf184f2d5fe tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:34.310404 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-515e543e-931f-4d31-9a9c-3bf184f2d5fe tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:34.512060 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-515e543e-931f-4d31-9a9c-3bf184f2d5fe tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:34.520797 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-515e543e-931f-4d31-9a9c-3bf184f2d5fe tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1365 microversion: 2.1 time: 0.233525 May 26 16:55:34.521479 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 131/244] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:34 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:35.078715 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4cf0da0f-9e85-4417-8570-fa322af94922 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:35.079922 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4cf0da0f-9e85-4417-8570-fa322af94922 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:35.097177 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4cf0da0f-9e85-4417-8570-fa322af94922 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:35.098000 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4cf0da0f-9e85-4417-8570-fa322af94922 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:35.099150 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4cf0da0f-9e85-4417-8570-fa322af94922 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:35.099777 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4cf0da0f-9e85-4417-8570-fa322af94922 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:35.303468 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4cf0da0f-9e85-4417-8570-fa322af94922 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:35.312985 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4cf0da0f-9e85-4417-8570-fa322af94922 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.238789 May 26 16:55:35.315022 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 114/245] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:35 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:35.543279 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-d06373d0-9cbf-4489-b2d5-95568ab7c1f6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:35.544179 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-d06373d0-9cbf-4489-b2d5-95568ab7c1f6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:35.555234 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d06373d0-9cbf-4489-b2d5-95568ab7c1f6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:35.561723 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d06373d0-9cbf-4489-b2d5-95568ab7c1f6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:35.561723 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d06373d0-9cbf-4489-b2d5-95568ab7c1f6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:35.561723 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d06373d0-9cbf-4489-b2d5-95568ab7c1f6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:35.725291 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d06373d0-9cbf-4489-b2d5-95568ab7c1f6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:35.739480 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-d06373d0-9cbf-4489-b2d5-95568ab7c1f6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1556 microversion: 2.1 time: 0.202998 May 26 16:55:35.740855 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 132/246] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:35 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1556 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:35.768618 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4ba22fe3-9570-4a83-a075-39eef1705a9c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:35.769381 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4ba22fe3-9570-4a83-a075-39eef1705a9c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:35.777056 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4ba22fe3-9570-4a83-a075-39eef1705a9c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:35.777550 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4ba22fe3-9570-4a83-a075-39eef1705a9c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:35.778337 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4ba22fe3-9570-4a83-a075-39eef1705a9c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:35.778780 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4ba22fe3-9570-4a83-a075-39eef1705a9c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:35.878644 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4ba22fe3-9570-4a83-a075-39eef1705a9c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117465 May 26 16:55:35.879666 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 115/247] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 26 16:55:35 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:36.337242 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-0004e289-9846-41c3-908c-7ca3f8cbf828 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:36.337909 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-0004e289-9846-41c3-908c-7ca3f8cbf828 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:36.384269 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0004e289-9846-41c3-908c-7ca3f8cbf828 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:36.384856 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0004e289-9846-41c3-908c-7ca3f8cbf828 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:36.390954 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0004e289-9846-41c3-908c-7ca3f8cbf828 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:36.391878 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0004e289-9846-41c3-908c-7ca3f8cbf828 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:36.426800 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=100 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:36.717298 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-0004e289-9846-41c3-908c-7ca3f8cbf828 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:36.756555 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-0004e289-9846-41c3-908c-7ca3f8cbf828 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.423787 May 26 16:55:36.771206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 133/248] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:36 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:37.683342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-623525875", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "networks": [{"uuid": "138add0c-7439-4779-a280-abe6357e82e9"}]}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:37.685219 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-b038b51e-c62e-451c-acf4-6c580456b6b4 req-e96bcca4-70db-4efc-9306-7726fef92891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922fbe1c-0632-41ec-b652-d4e1c457d234", "tag": "aa42d105-247d-49cd-9b56-b9f75a4b66eb"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:37.700289 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-b038b51e-c62e-451c-acf4-6c580456b6b4 req-e96bcca4-70db-4efc-9306-7726fef92891 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:37.701156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-b038b51e-c62e-451c-acf4-6c580456b6b4 req-e96bcca4-70db-4efc-9306-7726fef92891 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:37.722651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-b038b51e-c62e-451c-acf4-6c580456b6b4 req-e96bcca4-70db-4efc-9306-7726fef92891 service nova] Creating event network-changed:aa42d105-247d-49cd-9b56-b9f75a4b66eb for instance 922fbe1c-0632-41ec-b652-d4e1c457d234 on hv-cinder-83607 May 26 16:55:37.729654 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-b038b51e-c62e-451c-acf4-6c580456b6b4 req-e96bcca4-70db-4efc-9306-7726fef92891 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050754 May 26 16:55:37.732633 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 116/249] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:37.751619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.network.neutron [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] validate_networks() for [('138add0c-7439-4779-a280-abe6357e82e9', None, None, None, None, None)] {{(pid=124836) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:55:37.784315 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9bbaec4d-0bb4-47fb-aec8-75d8440c0909 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:37.784315 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9bbaec4d-0bb4-47fb-aec8-75d8440c0909 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:37.799480 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9bbaec4d-0bb4-47fb-aec8-75d8440c0909 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:37.799945 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9bbaec4d-0bb4-47fb-aec8-75d8440c0909 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:37.800939 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9bbaec4d-0bb4-47fb-aec8-75d8440c0909 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:37.801558 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9bbaec4d-0bb4-47fb-aec8-75d8440c0909 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:38.106476 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9bbaec4d-0bb4-47fb-aec8-75d8440c0909 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:38.127209 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9bbaec4d-0bb4-47fb-aec8-75d8440c0909 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.341041 May 26 16:55:38.128096 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 117/250] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:37 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:38.475627 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Flavor limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:55:38.476204 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Image limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:55:38.480282 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Flavor pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:55:38.480282 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Image pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:55:38.480282 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:55:38.492210 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:38.493485 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:38.494970 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:38.496213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:38.525164 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Getting quotas for project dc9eb3074bcf4c8eb5ddec86dd21f676. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:55:38.531535 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Getting quotas for user 14b1aff9e40a44dbabe2766d3e51f914 and project dc9eb3074bcf4c8eb5ddec86dd21f676. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:55:38.572656 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Going to run 1 instances... {{(pid=124836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:55:38.588056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:55:38.779844 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-1b32ee50-a4ac-4a07-a107-ca363e0add32 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.101186 May 26 16:55:38.780918 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 134/251] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 16:55:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 16:55:38.793613 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2fd0ac0e-c669-421b-a22d-3245b33da287 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:38.794715 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2fd0ac0e-c669-421b-a22d-3245b33da287 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:38.870677 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2fd0ac0e-c669-421b-a22d-3245b33da287 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:38.878910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2fd0ac0e-c669-421b-a22d-3245b33da287 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1213 microversion: 2.1 time: 0.091357 May 26 16:55:38.880993 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 118/252] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:38 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:39.151978 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-07d24890-f929-482a-a9e2-01d067bd0416 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:39.153505 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-07d24890-f929-482a-a9e2-01d067bd0416 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:39.178850 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-07d24890-f929-482a-a9e2-01d067bd0416 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:39.179619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-07d24890-f929-482a-a9e2-01d067bd0416 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:39.180894 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-07d24890-f929-482a-a9e2-01d067bd0416 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:39.181789 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-07d24890-f929-482a-a9e2-01d067bd0416 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:39.556485 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-07d24890-f929-482a-a9e2-01d067bd0416 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:39.565506 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-07d24890-f929-482a-a9e2-01d067bd0416 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.420521 May 26 16:55:39.567106 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 135/253] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:39 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:39.903979 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0cffe586-1e7e-483d-b7a3-8f2cf34c4b3d tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:39.904642 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0cffe586-1e7e-483d-b7a3-8f2cf34c4b3d tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:40.002466 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0cffe586-1e7e-483d-b7a3-8f2cf34c4b3d tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:40.012442 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0cffe586-1e7e-483d-b7a3-8f2cf34c4b3d tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1213 microversion: 2.1 time: 0.114940 May 26 16:55:40.014323 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 119/254] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:39 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1213 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:40.590340 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-eb3f260a-bc40-4607-a071-c023e0b58392 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:40.591125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-eb3f260a-bc40-4607-a071-c023e0b58392 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:40.598064 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eb3f260a-bc40-4607-a071-c023e0b58392 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:40.598583 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eb3f260a-bc40-4607-a071-c023e0b58392 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:40.599925 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eb3f260a-bc40-4607-a071-c023e0b58392 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:40.600669 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eb3f260a-bc40-4607-a071-c023e0b58392 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:40.812537 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-eb3f260a-bc40-4607-a071-c023e0b58392 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:40.823164 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-eb3f260a-bc40-4607-a071-c023e0b58392 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1502 microversion: 2.1 time: 0.237104 May 26 16:55:40.823164 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 136/255] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:40 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1502 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:40.847594 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-13615f1e-9d2d-4c9f-96e4-851d9bf0dc9b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d7e2161-05d7-4a8f-80bb-ae2cfd7ec947"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:40.850607 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-13615f1e-9d2d-4c9f-96e4-851d9bf0dc9b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:40.863618 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13615f1e-9d2d-4c9f-96e4-851d9bf0dc9b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:40.864113 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13615f1e-9d2d-4c9f-96e4-851d9bf0dc9b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:40.865152 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13615f1e-9d2d-4c9f-96e4-851d9bf0dc9b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:40.865895 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13615f1e-9d2d-4c9f-96e4-851d9bf0dc9b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:40.899322 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-13615f1e-9d2d-4c9f-96e4-851d9bf0dc9b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] HTTP exception thrown: Cannot 'attach_volume' instance 3ecc34c3-8a11-43df-b56d-0996916a0187 while it is in vm_state rescued May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-13615f1e-9d2d-4c9f-96e4-851d9bf0dc9b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Request method failure captured: May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: POST /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187/os-volume_attachments HTTP/1.1 May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 74 May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7CH0rRgnMIlqD063iAZ1ez0QCmlEZqp8QO5ZHjV6XSABZyVeCa3_rL4GukWUzmymH9jymZkR9aYr_V2RQaROCLGEkpNcCgSPyMdlFCJNjPh_1Ze5FLmietbK2CJnk7y7SKXRAka654COK9sD96s20UhiFkxqVLsn7TyJAFc87ArqJ8 May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 5150e5b054d34d09a3cb69e35f9c86dd May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1243169788 May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 16:55:40.901031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 16:55:40.902764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5150e5b054d34d09a3cb69e35f9c86dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5150e5b054d34d09a3cb69e35f9c86dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5150e5b054d34d09a3cb69e35f9c86dd", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5150e5b054d34d09a3cb69e35f9c86dd"}]}] May 26 16:55:40.902764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1243169788 May 26 16:55:40.902764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 5150e5b054d34d09a3cb69e35f9c86dd May 26 16:55:40.902764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1243169788 May 26 16:55:40.902764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-ServerRescueNegativeTestJSON-1243169788-project May 26 16:55:40.902764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 16:55:40.902764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 16:55:40.902764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: 1cf5ba73296e41c4ab58a6a962b578d3 May 26 16:55:40.902764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1243169788-project May 26 16:55:40.902764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: May 26 16:55:40.902764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {"volumeAttachment": {"volumeId": "6d7e2161-05d7-4a8f-80bb-ae2cfd7ec947"}} May 26 16:55:40.902764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Cannot 'attach_volume' instance 3ecc34c3-8a11-43df-b56d-0996916a0187 while it is in vm_state rescued May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'server_id': '3ecc34c3-8a11-43df-b56d-0996916a0187', 'body': {'volumeAttachment': {'volumeId': '6d7e2161-05d7-4a8f-80bb-ae2cfd7ec947'}}} May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3ecc34c3-8a11-43df-b56d-0996916a0187 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:55:40.904079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3ecc34c3-8a11-43df-b56d-0996916a0187 while it is in vm_state rescued May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:55:40.906999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:55:40.909570 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:55:40.909570 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:55:40.909570 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3ecc34c3-8a11-43df-b56d-0996916a0187 while it is in vm_state rescued May 26 16:55:40.909570 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:55:40.909570 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-13615f1e-9d2d-4c9f-96e4-851d9bf0dc9b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Returning 409 to user: Cannot 'attach_volume' instance 3ecc34c3-8a11-43df-b56d-0996916a0187 while it is in vm_state rescued {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:55:40.909570 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-13615f1e-9d2d-4c9f-96e4-851d9bf0dc9b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "POST /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061379 May 26 16:55:40.909570 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 120/256] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 26 16:55:40 2022] POST /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 26 16:55:40.925241 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-08de037f-779f-4042-816f-c99fc837d6a5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:40.926404 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-08de037f-779f-4042-816f-c99fc837d6a5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:40.938273 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-08de037f-779f-4042-816f-c99fc837d6a5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:40.939252 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-08de037f-779f-4042-816f-c99fc837d6a5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:40.942877 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-08de037f-779f-4042-816f-c99fc837d6a5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:40.944037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-08de037f-779f-4042-816f-c99fc837d6a5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:41.040593 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-04ce98c1-a078-46a6-8c13-ef7f5b452d59 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:41.043231 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-04ce98c1-a078-46a6-8c13-ef7f5b452d59 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:41.061042 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04ce98c1-a078-46a6-8c13-ef7f5b452d59 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:41.062129 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04ce98c1-a078-46a6-8c13-ef7f5b452d59 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:41.063463 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04ce98c1-a078-46a6-8c13-ef7f5b452d59 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:41.064181 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-04ce98c1-a078-46a6-8c13-ef7f5b452d59 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:41.187235 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-04ce98c1-a078-46a6-8c13-ef7f5b452d59 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:41.206611 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-04ce98c1-a078-46a6-8c13-ef7f5b452d59 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1209 microversion: 2.1 time: 0.175120 May 26 16:55:41.208066 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 121/257] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:41 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1209 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:41.281288 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-08de037f-779f-4042-816f-c99fc837d6a5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "POST /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187/action" status: 202 len: 0 microversion: 2.1 time: 0.364913 May 26 16:55:41.294200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 137/258] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 26 16:55:40 2022] POST /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:55:41.306963 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d854d28b-0999-4b3a-b8f7-9ab3a0fbb46b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:41.307913 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d854d28b-0999-4b3a-b8f7-9ab3a0fbb46b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:41.316559 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d854d28b-0999-4b3a-b8f7-9ab3a0fbb46b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:41.317434 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d854d28b-0999-4b3a-b8f7-9ab3a0fbb46b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:41.321357 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d854d28b-0999-4b3a-b8f7-9ab3a0fbb46b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:41.321357 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d854d28b-0999-4b3a-b8f7-9ab3a0fbb46b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:41.543593 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d854d28b-0999-4b3a-b8f7-9ab3a0fbb46b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:41.555302 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d854d28b-0999-4b3a-b8f7-9ab3a0fbb46b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1510 microversion: 2.1 time: 0.254849 May 26 16:55:41.556281 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 122/259] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:41 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:41.622662 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f5353693-6aad-4b9f-920d-7d4e433d6d5f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:41.624888 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f5353693-6aad-4b9f-920d-7d4e433d6d5f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:41.637807 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f5353693-6aad-4b9f-920d-7d4e433d6d5f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:41.638543 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f5353693-6aad-4b9f-920d-7d4e433d6d5f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:41.639880 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f5353693-6aad-4b9f-920d-7d4e433d6d5f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:41.640658 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f5353693-6aad-4b9f-920d-7d4e433d6d5f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:41.702172 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f5353693-6aad-4b9f-920d-7d4e433d6d5f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/ips" status: 200 len: 145 microversion: 2.1 time: 0.087571 May 26 16:55:41.703228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 138/260] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 26 16:55:41 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/ips => generated 145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:42.237169 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ecdb3454-f203-4a0d-96c2-c461b5107e8f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:42.238666 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ecdb3454-f203-4a0d-96c2-c461b5107e8f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:42.247889 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ecdb3454-f203-4a0d-96c2-c461b5107e8f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:42.253506 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ecdb3454-f203-4a0d-96c2-c461b5107e8f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:42.256038 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ecdb3454-f203-4a0d-96c2-c461b5107e8f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:42.257454 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ecdb3454-f203-4a0d-96c2-c461b5107e8f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:42.386449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ecdb3454-f203-4a0d-96c2-c461b5107e8f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:42.396127 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ecdb3454-f203-4a0d-96c2-c461b5107e8f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1273 microversion: 2.1 time: 0.163680 May 26 16:55:42.398207 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 123/261] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:42 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:42.582057 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-94b39425-a3da-49c1-bdf1-58ead1560ea3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:42.584437 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-94b39425-a3da-49c1-bdf1-58ead1560ea3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:42.599490 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94b39425-a3da-49c1-bdf1-58ead1560ea3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:42.601825 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94b39425-a3da-49c1-bdf1-58ead1560ea3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:42.603896 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94b39425-a3da-49c1-bdf1-58ead1560ea3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:42.605003 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94b39425-a3da-49c1-bdf1-58ead1560ea3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:42.917696 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-94b39425-a3da-49c1-bdf1-58ead1560ea3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:42.935549 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-94b39425-a3da-49c1-bdf1-58ead1560ea3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1510 microversion: 2.1 time: 0.361320 May 26 16:55:42.936331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 139/262] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:42 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:43.137168 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b2d32045-e741-468a-8a6f-a378676bc9dd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:43.137997 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b2d32045-e741-468a-8a6f-a378676bc9dd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:43.149665 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b2d32045-e741-468a-8a6f-a378676bc9dd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:43.150391 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b2d32045-e741-468a-8a6f-a378676bc9dd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:43.151776 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b2d32045-e741-468a-8a6f-a378676bc9dd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:43.152366 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b2d32045-e741-468a-8a6f-a378676bc9dd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:43.299805 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b2d32045-e741-468a-8a6f-a378676bc9dd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/ips" status: 200 len: 152 microversion: 2.20 time: 0.063328 May 26 16:55:43.299805 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 124/263] 10.222.0.48 () {60 vars in 1288 bytes} [Thu May 26 16:55:43 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/ips => generated 152 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:55:43.425808 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5f0d3b89-e472-485a-b0a5-330b6ea85ee4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:43.426337 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5f0d3b89-e472-485a-b0a5-330b6ea85ee4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:43.435708 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5f0d3b89-e472-485a-b0a5-330b6ea85ee4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:43.436518 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5f0d3b89-e472-485a-b0a5-330b6ea85ee4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:43.438128 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5f0d3b89-e472-485a-b0a5-330b6ea85ee4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:43.438923 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5f0d3b89-e472-485a-b0a5-330b6ea85ee4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:43.596951 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5f0d3b89-e472-485a-b0a5-330b6ea85ee4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:43.612903 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5f0d3b89-e472-485a-b0a5-330b6ea85ee4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1271 microversion: 2.1 time: 0.190837 May 26 16:55:43.622859 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 140/264] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:43 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:43.957824 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e536c532-b4b2-4d8f-a734-3972b9021127 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:43.959574 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e536c532-b4b2-4d8f-a734-3972b9021127 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:43.968233 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e536c532-b4b2-4d8f-a734-3972b9021127 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:43.969496 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e536c532-b4b2-4d8f-a734-3972b9021127 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:43.970174 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e536c532-b4b2-4d8f-a734-3972b9021127 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:43.970620 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e536c532-b4b2-4d8f-a734-3972b9021127 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:43.990737 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:44.276682 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e536c532-b4b2-4d8f-a734-3972b9021127 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:44.299765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e536c532-b4b2-4d8f-a734-3972b9021127 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1510 microversion: 2.1 time: 0.344877 May 26 16:55:44.301733 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 125/265] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:43 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1510 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:44.646315 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6a71918d-6f3c-46ab-b99e-e112fcddecf8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:44.648289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6a71918d-6f3c-46ab-b99e-e112fcddecf8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:44.665490 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6a71918d-6f3c-46ab-b99e-e112fcddecf8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:44.666275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6a71918d-6f3c-46ab-b99e-e112fcddecf8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:44.667626 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6a71918d-6f3c-46ab-b99e-e112fcddecf8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:44.675115 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6a71918d-6f3c-46ab-b99e-e112fcddecf8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:44.903083 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6a71918d-6f3c-46ab-b99e-e112fcddecf8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:44.912898 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6a71918d-6f3c-46ab-b99e-e112fcddecf8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1313 microversion: 2.1 time: 0.274120 May 26 16:55:44.914964 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 141/266] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:44 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:45.329069 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b360e0b1-e3a7-4e2b-9414-924f060a98a0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:45.331408 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b360e0b1-e3a7-4e2b-9414-924f060a98a0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:45.337721 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b360e0b1-e3a7-4e2b-9414-924f060a98a0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:45.338399 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b360e0b1-e3a7-4e2b-9414-924f060a98a0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:45.339296 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b360e0b1-e3a7-4e2b-9414-924f060a98a0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:45.339771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b360e0b1-e3a7-4e2b-9414-924f060a98a0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:45.469245 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-dd4f403d-5cf8-421d-9018-6601e0189c49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25c6e31e-2d91-4bfa-a93f-1ad9d5ec37f9"}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:45.484053 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-dd4f403d-5cf8-421d-9018-6601e0189c49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:45.493175 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dd4f403d-5cf8-421d-9018-6601e0189c49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:45.494484 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dd4f403d-5cf8-421d-9018-6601e0189c49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:45.495683 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dd4f403d-5cf8-421d-9018-6601e0189c49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:45.497700 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dd4f403d-5cf8-421d-9018-6601e0189c49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:45.621022 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b360e0b1-e3a7-4e2b-9414-924f060a98a0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:45.638741 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b360e0b1-e3a7-4e2b-9414-924f060a98a0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1510 microversion: 2.1 time: 0.315632 May 26 16:55:45.640172 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 126/267] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:45 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1510 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:45.939031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cfe33f6a-1018-4880-b37a-2204ebb3ce85 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:45.940321 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cfe33f6a-1018-4880-b37a-2204ebb3ce85 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:45.952974 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfe33f6a-1018-4880-b37a-2204ebb3ce85 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:45.953907 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfe33f6a-1018-4880-b37a-2204ebb3ce85 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:45.955534 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfe33f6a-1018-4880-b37a-2204ebb3ce85 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:45.956437 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cfe33f6a-1018-4880-b37a-2204ebb3ce85 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:46.227703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cfe33f6a-1018-4880-b37a-2204ebb3ce85 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:46.238923 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cfe33f6a-1018-4880-b37a-2204ebb3ce85 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1313 microversion: 2.1 time: 0.307317 May 26 16:55:46.239716 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 127/268] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:45 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:46.664095 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e7e67b69-1071-4b67-a66f-045047790d95 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:46.670967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e7e67b69-1071-4b67-a66f-045047790d95 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:46.690885 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7e67b69-1071-4b67-a66f-045047790d95 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:46.692011 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7e67b69-1071-4b67-a66f-045047790d95 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:46.693671 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7e67b69-1071-4b67-a66f-045047790d95 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:46.694739 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7e67b69-1071-4b67-a66f-045047790d95 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:46.853671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-dd4f403d-5cf8-421d-9018-6601e0189c49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "POST /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.396476 May 26 16:55:46.856533 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 142/269] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 26 16:55:45 2022] POST /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/os-volume_attachments => generated 194 bytes in 1401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:46.964678 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e7e67b69-1071-4b67-a66f-045047790d95 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:46.977568 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e7e67b69-1071-4b67-a66f-045047790d95 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1516 microversion: 2.1 time: 0.322267 May 26 16:55:46.986088 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 128/270] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:46 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1516 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:47.048405 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-0cb2a560-e3c5-41f7-978a-02bd7cf2e578 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:47.049192 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-0cb2a560-e3c5-41f7-978a-02bd7cf2e578 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:47.060092 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0cb2a560-e3c5-41f7-978a-02bd7cf2e578 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:47.060900 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0cb2a560-e3c5-41f7-978a-02bd7cf2e578 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:47.061845 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0cb2a560-e3c5-41f7-978a-02bd7cf2e578 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:47.062570 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0cb2a560-e3c5-41f7-978a-02bd7cf2e578 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:47.107624 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-0cb2a560-e3c5-41f7-978a-02bd7cf2e578 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lazy-loading 'flavor' on Instance uuid d0daf7ae-8eab-479b-b4cb-380a68f5bfaa {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:55:47.274368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ee27db60-999e-48d9-b75e-4c35194f8bd6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:47.274984 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ee27db60-999e-48d9-b75e-4c35194f8bd6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:47.284583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee27db60-999e-48d9-b75e-4c35194f8bd6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:47.285446 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee27db60-999e-48d9-b75e-4c35194f8bd6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:47.287531 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee27db60-999e-48d9-b75e-4c35194f8bd6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:47.288885 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee27db60-999e-48d9-b75e-4c35194f8bd6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:47.488705 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ee27db60-999e-48d9-b75e-4c35194f8bd6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:47.501782 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ee27db60-999e-48d9-b75e-4c35194f8bd6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1313 microversion: 2.1 time: 0.232617 May 26 16:55:47.503353 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 129/271] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:47 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:47.528806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-b5116a4d-d356-4449-8be5-652aa308f9e8 req-b693b27d-5085-4e3d-b056-2f01cca81199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a0e5df4-33a2-4d03-8f86-c68743d1dbba", "tag": "b7bfafc7-59b7-4831-81be-c5ef5e045f41"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:47.536987 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-b5116a4d-d356-4449-8be5-652aa308f9e8 req-b693b27d-5085-4e3d-b056-2f01cca81199 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:47.537579 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-b5116a4d-d356-4449-8be5-652aa308f9e8 req-b693b27d-5085-4e3d-b056-2f01cca81199 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:47.563005 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-b5116a4d-d356-4449-8be5-652aa308f9e8 req-b693b27d-5085-4e3d-b056-2f01cca81199 service nova] Creating event network-changed:b7bfafc7-59b7-4831-81be-c5ef5e045f41 for instance 1a0e5df4-33a2-4d03-8f86-c68743d1dbba on hv-cinder-83607 May 26 16:55:47.572558 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-b5116a4d-d356-4449-8be5-652aa308f9e8 req-b693b27d-5085-4e3d-b056-2f01cca81199 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049788 May 26 16:55:47.573606 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 130/272] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:48.047311 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-0cb2a560-e3c5-41f7-978a-02bd7cf2e578 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "POST /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/action" status: 202 len: 0 microversion: 2.20 time: 1.003577 May 26 16:55:48.048962 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 143/273] 10.222.0.48 () {62 vars in 1318 bytes} [Thu May 26 16:55:47 2022] POST /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/action => generated 0 bytes in 1006 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 16:55:48.068987 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-184eaca6-f710-4326-b0be-bc2d709cbc2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:48.071656 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-184eaca6-f710-4326-b0be-bc2d709cbc2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:48.089031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-184eaca6-f710-4326-b0be-bc2d709cbc2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:48.090312 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-184eaca6-f710-4326-b0be-bc2d709cbc2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:48.091998 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-184eaca6-f710-4326-b0be-bc2d709cbc2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:48.092861 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-184eaca6-f710-4326-b0be-bc2d709cbc2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:48.281602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-184eaca6-f710-4326-b0be-bc2d709cbc2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:48.293311 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-184eaca6-f710-4326-b0be-bc2d709cbc2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:48.295133 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-184eaca6-f710-4326-b0be-bc2d709cbc2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:48.296608 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-184eaca6-f710-4326-b0be-bc2d709cbc2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.239995 May 26 16:55:48.297360 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 131/274] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:55:48 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:55:48.527125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:48.532237 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4d969b44-afab-4f80-bb90-002b6fd490e8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:48.533062 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4d969b44-afab-4f80-bb90-002b6fd490e8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:48.540176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=6 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:48.542651 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4d969b44-afab-4f80-bb90-002b6fd490e8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:48.543175 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4d969b44-afab-4f80-bb90-002b6fd490e8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:48.544229 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4d969b44-afab-4f80-bb90-002b6fd490e8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:48.544891 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4d969b44-afab-4f80-bb90-002b6fd490e8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:48.732199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4d969b44-afab-4f80-bb90-002b6fd490e8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:48.747172 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4d969b44-afab-4f80-bb90-002b6fd490e8 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1313 microversion: 2.1 time: 0.220824 May 26 16:55:48.752114 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 144/275] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:48 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:49.316636 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e7f80f4c-737b-4f82-9315-4cdb4a59a0d9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:49.317252 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e7f80f4c-737b-4f82-9315-4cdb4a59a0d9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:49.324271 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7f80f4c-737b-4f82-9315-4cdb4a59a0d9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:49.324716 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7f80f4c-737b-4f82-9315-4cdb4a59a0d9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:49.325624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7f80f4c-737b-4f82-9315-4cdb4a59a0d9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:49.325982 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7f80f4c-737b-4f82-9315-4cdb4a59a0d9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:49.504154 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e7f80f4c-737b-4f82-9315-4cdb4a59a0d9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:49.514363 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e7f80f4c-737b-4f82-9315-4cdb4a59a0d9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:49.516087 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e7f80f4c-737b-4f82-9315-4cdb4a59a0d9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:49.517397 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e7f80f4c-737b-4f82-9315-4cdb4a59a0d9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.204967 May 26 16:55:49.518017 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 132/276] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:55:49 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:55:49.774582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-758d4cc5-4f53-4f41-8852-4e8f8d1e1c12 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:49.775527 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-758d4cc5-4f53-4f41-8852-4e8f8d1e1c12 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:49.777930 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:49.784037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-758d4cc5-4f53-4f41-8852-4e8f8d1e1c12 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:49.784540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-758d4cc5-4f53-4f41-8852-4e8f8d1e1c12 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:49.791594 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-758d4cc5-4f53-4f41-8852-4e8f8d1e1c12 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:49.791594 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-758d4cc5-4f53-4f41-8852-4e8f8d1e1c12 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:49.995656 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-758d4cc5-4f53-4f41-8852-4e8f8d1e1c12 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:50.013023 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-758d4cc5-4f53-4f41-8852-4e8f8d1e1c12 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1313 microversion: 2.1 time: 0.241768 May 26 16:55:50.015602 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 145/277] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:49 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:50.541695 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a62a9caa-35b0-4f7a-ac60-b8e640d3cae7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:50.542833 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a62a9caa-35b0-4f7a-ac60-b8e640d3cae7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:50.548375 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=4 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:50.556472 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a62a9caa-35b0-4f7a-ac60-b8e640d3cae7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:50.557365 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a62a9caa-35b0-4f7a-ac60-b8e640d3cae7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:50.558759 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a62a9caa-35b0-4f7a-ac60-b8e640d3cae7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:50.559546 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a62a9caa-35b0-4f7a-ac60-b8e640d3cae7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:50.724783 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a62a9caa-35b0-4f7a-ac60-b8e640d3cae7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:50.736328 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a62a9caa-35b0-4f7a-ac60-b8e640d3cae7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:50.740188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a62a9caa-35b0-4f7a-ac60-b8e640d3cae7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:50.742442 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a62a9caa-35b0-4f7a-ac60-b8e640d3cae7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.208990 May 26 16:55:50.743469 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 133/278] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:55:50 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:55:51.042594 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-d4dca070-f648-4f4d-befa-91fdcfbcd0f4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:51.043356 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-d4dca070-f648-4f4d-befa-91fdcfbcd0f4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:51.051340 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d4dca070-f648-4f4d-befa-91fdcfbcd0f4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:51.051890 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d4dca070-f648-4f4d-befa-91fdcfbcd0f4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:51.052690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d4dca070-f648-4f4d-befa-91fdcfbcd0f4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:51.053211 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d4dca070-f648-4f4d-befa-91fdcfbcd0f4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:51.217115 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d4dca070-f648-4f4d-befa-91fdcfbcd0f4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:51.219993 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:51.227905 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-d4dca070-f648-4f4d-befa-91fdcfbcd0f4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1313 microversion: 2.1 time: 0.190626 May 26 16:55:51.228486 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 146/279] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:51 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:51.575998 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d36f3f4e-a0c2-467c-8dc4-0240422ff1e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Action: 'create', calling method: .version_select at 0x7fbe805d3ca0>, body: {"keypair": {"name": "tempest-keypair-1654103350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhac42yaGbsCaU7USb9XLbBiEkZ+XK8iJyPSuF5w82LjCzo+od6v7nQm9uL4l/7p1XpVFR9ii7QPcZmH2kkNgfA8qLwQnzcFjJ0zabfSZk/VuyTm//asExyhytKF0RNhw=="}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:51.604837 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-d36f3f4e-a0c2-467c-8dc4-0240422ff1e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Getting quotas for project 5150e5b054d34d09a3cb69e35f9c86dd. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:55:51.618856 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-d36f3f4e-a0c2-467c-8dc4-0240422ff1e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Getting quotas for user 1cf5ba73296e41c4ab58a6a962b578d3 and project 5150e5b054d34d09a3cb69e35f9c86dd. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:55:51.768519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-701cf608-2b45-4a1d-aea7-30c429e64d64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:51.769326 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-701cf608-2b45-4a1d-aea7-30c429e64d64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:51.778521 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-701cf608-2b45-4a1d-aea7-30c429e64d64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:51.779145 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-701cf608-2b45-4a1d-aea7-30c429e64d64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:51.780222 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-701cf608-2b45-4a1d-aea7-30c429e64d64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:51.780789 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-701cf608-2b45-4a1d-aea7-30c429e64d64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:51.848893 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d36f3f4e-a0c2-467c-8dc4-0240422ff1e2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.281510 May 26 16:55:51.850173 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 134/280] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 26 16:55:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:51.988401 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-701cf608-2b45-4a1d-aea7-30c429e64d64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:51.998041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-701cf608-2b45-4a1d-aea7-30c429e64d64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:52.000444 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-701cf608-2b45-4a1d-aea7-30c429e64d64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:52.002744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-701cf608-2b45-4a1d-aea7-30c429e64d64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.238432 May 26 16:55:52.007701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 147/281] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:55:51 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:55:52.248857 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6c2a8c79-c2f1-4359-89eb-b68ccfd03477 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:52.249508 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6c2a8c79-c2f1-4359-89eb-b68ccfd03477 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:52.258484 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6c2a8c79-c2f1-4359-89eb-b68ccfd03477 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:52.258940 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6c2a8c79-c2f1-4359-89eb-b68ccfd03477 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:52.259737 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6c2a8c79-c2f1-4359-89eb-b68ccfd03477 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:52.260176 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6c2a8c79-c2f1-4359-89eb-b68ccfd03477 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:52.416680 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6c2a8c79-c2f1-4359-89eb-b68ccfd03477 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:52.424888 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6c2a8c79-c2f1-4359-89eb-b68ccfd03477 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1313 microversion: 2.1 time: 0.180386 May 26 16:55:52.425517 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 135/282] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:52 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:53.029753 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-79a5611e-f1aa-4806-bf2c-3c3f9f1ee311 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:53.030373 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-79a5611e-f1aa-4806-bf2c-3c3f9f1ee311 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:53.040056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-79a5611e-f1aa-4806-bf2c-3c3f9f1ee311 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:53.040802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-79a5611e-f1aa-4806-bf2c-3c3f9f1ee311 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:53.042451 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-79a5611e-f1aa-4806-bf2c-3c3f9f1ee311 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:53.043215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-79a5611e-f1aa-4806-bf2c-3c3f9f1ee311 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:53.220547 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-79a5611e-f1aa-4806-bf2c-3c3f9f1ee311 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:53.229695 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-79a5611e-f1aa-4806-bf2c-3c3f9f1ee311 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:53.235455 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-79a5611e-f1aa-4806-bf2c-3c3f9f1ee311 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:53.235455 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-79a5611e-f1aa-4806-bf2c-3c3f9f1ee311 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.207567 May 26 16:55:53.237545 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 148/283] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:55:53 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:55:53.444217 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2cb4bf0d-ed5b-4ad8-8fb1-6fe74d13a9c3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:53.445415 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2cb4bf0d-ed5b-4ad8-8fb1-6fe74d13a9c3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:53.448601 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:53.454213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2cb4bf0d-ed5b-4ad8-8fb1-6fe74d13a9c3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:53.454766 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2cb4bf0d-ed5b-4ad8-8fb1-6fe74d13a9c3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:53.455707 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2cb4bf0d-ed5b-4ad8-8fb1-6fe74d13a9c3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:53.456229 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2cb4bf0d-ed5b-4ad8-8fb1-6fe74d13a9c3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:53.613983 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2cb4bf0d-ed5b-4ad8-8fb1-6fe74d13a9c3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:53.619931 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2cb4bf0d-ed5b-4ad8-8fb1-6fe74d13a9c3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1313 microversion: 2.1 time: 0.179662 May 26 16:55:53.620525 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 136/284] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:53 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:54.253577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-92909e39-b2b2-4a08-ba05-84da56e42b03 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:54.254213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-92909e39-b2b2-4a08-ba05-84da56e42b03 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:54.261611 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-92909e39-b2b2-4a08-ba05-84da56e42b03 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:54.262069 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-92909e39-b2b2-4a08-ba05-84da56e42b03 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:54.262852 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-92909e39-b2b2-4a08-ba05-84da56e42b03 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:54.263295 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-92909e39-b2b2-4a08-ba05-84da56e42b03 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:54.412805 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-92909e39-b2b2-4a08-ba05-84da56e42b03 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:54.424028 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-92909e39-b2b2-4a08-ba05-84da56e42b03 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:54.426538 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-92909e39-b2b2-4a08-ba05-84da56e42b03 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:54.428045 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-92909e39-b2b2-4a08-ba05-84da56e42b03 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.179791 May 26 16:55:54.428629 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 149/285] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:55:54 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:55:54.637938 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9de07c48-a6a5-4218-96fc-22e3ba63991a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:54.638365 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9de07c48-a6a5-4218-96fc-22e3ba63991a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:54.649405 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9de07c48-a6a5-4218-96fc-22e3ba63991a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:54.650490 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9de07c48-a6a5-4218-96fc-22e3ba63991a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:54.652064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9de07c48-a6a5-4218-96fc-22e3ba63991a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:54.652869 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9de07c48-a6a5-4218-96fc-22e3ba63991a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:54.674690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1843457928", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6174ed6-c511-43d9-b82c-ba126d400329"}], "security_groups": [{"name": "tempest-securitygroup--512047878"}], "key_name": "tempest-keypair-1654103350", "user_data": "}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:54.842745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.network.neutron [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] validate_networks() for [('b6174ed6-c511-43d9-b82c-ba126d400329', None, None, None, None, None)] {{(pid=124836) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:55:54.852564 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9de07c48-a6a5-4218-96fc-22e3ba63991a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:54.860454 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9de07c48-a6a5-4218-96fc-22e3ba63991a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1313 microversion: 2.1 time: 0.227489 May 26 16:55:54.861075 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 137/286] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:54 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:55.296676 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Flavor limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:55:55.297200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Image limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:55:55.297629 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Flavor pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:55:55.298043 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Image pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:55:55.298682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:55:55.313180 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:55.313701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:55.314648 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:55.315078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:55.333971 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Getting quotas for project 5150e5b054d34d09a3cb69e35f9c86dd. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:55:55.343542 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Getting quotas for user 1cf5ba73296e41c4ab58a6a962b578d3 and project 5150e5b054d34d09a3cb69e35f9c86dd. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:55:55.357480 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Going to run 1 instances... {{(pid=124836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:55:55.360816 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:55:55.454378 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-67d6dd1a-33fa-44e3-95f9-eefe690821f4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:55.454953 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-67d6dd1a-33fa-44e3-95f9-eefe690821f4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:55.461695 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67d6dd1a-33fa-44e3-95f9-eefe690821f4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:55.477005 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67d6dd1a-33fa-44e3-95f9-eefe690821f4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:55.477005 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67d6dd1a-33fa-44e3-95f9-eefe690821f4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:55.477005 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67d6dd1a-33fa-44e3-95f9-eefe690821f4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:55.583925 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-bb608855-a08e-40de-9d64-fe4546a43139 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.914285 May 26 16:55:55.584907 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 150/287] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 16:55:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 16:55:55.602419 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-eaf7a7c3-dcf4-436a-8d0d-aa573a2c1075 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:55.604092 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-eaf7a7c3-dcf4-436a-8d0d-aa573a2c1075 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:55.636582 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-67d6dd1a-33fa-44e3-95f9-eefe690821f4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:55.647322 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-67d6dd1a-33fa-44e3-95f9-eefe690821f4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:55.650176 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-67d6dd1a-33fa-44e3-95f9-eefe690821f4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:55.664678 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-67d6dd1a-33fa-44e3-95f9-eefe690821f4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.202045 May 26 16:55:55.664678 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 138/288] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:55:55 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:55:55.692934 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-eaf7a7c3-dcf4-436a-8d0d-aa573a2c1075 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:55.706979 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-eaf7a7c3-dcf4-436a-8d0d-aa573a2c1075 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1246 microversion: 2.1 time: 0.107590 May 26 16:55:55.706979 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 151/289] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:55 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1246 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:55.884538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e4ebc2c1-5a26-4b01-bdfe-18489c368281 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:55.887533 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e4ebc2c1-5a26-4b01-bdfe-18489c368281 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:55.906966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4ebc2c1-5a26-4b01-bdfe-18489c368281 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:55.907534 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4ebc2c1-5a26-4b01-bdfe-18489c368281 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:55.908357 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4ebc2c1-5a26-4b01-bdfe-18489c368281 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:55.908803 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4ebc2c1-5a26-4b01-bdfe-18489c368281 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:56.099533 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e4ebc2c1-5a26-4b01-bdfe-18489c368281 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:56.112163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e4ebc2c1-5a26-4b01-bdfe-18489c368281 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1313 microversion: 2.1 time: 0.237620 May 26 16:55:56.125938 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 139/290] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:55 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:56.678191 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3f77ccda-8221-407a-9dbf-2676eedd473e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:56.679588 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3f77ccda-8221-407a-9dbf-2676eedd473e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:56.688311 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3f77ccda-8221-407a-9dbf-2676eedd473e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:56.689636 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3f77ccda-8221-407a-9dbf-2676eedd473e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:56.690911 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3f77ccda-8221-407a-9dbf-2676eedd473e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:56.691587 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3f77ccda-8221-407a-9dbf-2676eedd473e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:56.730728 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2e3ec692-e9f3-4687-a3ec-2486a37773ae tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:56.731959 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2e3ec692-e9f3-4687-a3ec-2486a37773ae tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:56.740106 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2e3ec692-e9f3-4687-a3ec-2486a37773ae tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:56.740949 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2e3ec692-e9f3-4687-a3ec-2486a37773ae tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:56.742224 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2e3ec692-e9f3-4687-a3ec-2486a37773ae tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:56.742731 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2e3ec692-e9f3-4687-a3ec-2486a37773ae tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:56.832365 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2e3ec692-e9f3-4687-a3ec-2486a37773ae tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:56.851315 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2e3ec692-e9f3-4687-a3ec-2486a37773ae tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1250 microversion: 2.1 time: 0.125207 May 26 16:55:56.852713 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 140/291] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:56 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1250 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:56.936534 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3f77ccda-8221-407a-9dbf-2676eedd473e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:56.959694 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3f77ccda-8221-407a-9dbf-2676eedd473e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:56.963521 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3f77ccda-8221-407a-9dbf-2676eedd473e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:56.965733 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3f77ccda-8221-407a-9dbf-2676eedd473e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.295740 May 26 16:55:56.967960 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 152/292] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:55:56 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:55:57.140505 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2eb83305-7fe0-4e59-86d6-a235705fc209 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:57.141680 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2eb83305-7fe0-4e59-86d6-a235705fc209 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:57.150306 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2eb83305-7fe0-4e59-86d6-a235705fc209 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:57.151046 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2eb83305-7fe0-4e59-86d6-a235705fc209 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:57.151846 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2eb83305-7fe0-4e59-86d6-a235705fc209 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:57.152290 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2eb83305-7fe0-4e59-86d6-a235705fc209 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:57.326307 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2eb83305-7fe0-4e59-86d6-a235705fc209 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:57.346301 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2eb83305-7fe0-4e59-86d6-a235705fc209 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1313 microversion: 2.1 time: 0.209340 May 26 16:55:57.346301 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 141/293] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:57 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:57.874668 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-bebdea07-63fe-4ba9-85c6-5b7dedde11ce tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:57.875781 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-bebdea07-63fe-4ba9-85c6-5b7dedde11ce tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:57.887811 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bebdea07-63fe-4ba9-85c6-5b7dedde11ce tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:57.888628 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bebdea07-63fe-4ba9-85c6-5b7dedde11ce tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:57.890124 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bebdea07-63fe-4ba9-85c6-5b7dedde11ce tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:57.891260 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bebdea07-63fe-4ba9-85c6-5b7dedde11ce tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:57.989419 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c17d9d88-4520-46c6-8823-8701bb12bd31 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:57.990604 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c17d9d88-4520-46c6-8823-8701bb12bd31 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:57.994901 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-bebdea07-63fe-4ba9-85c6-5b7dedde11ce tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:58.003826 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c17d9d88-4520-46c6-8823-8701bb12bd31 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:58.004142 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-bebdea07-63fe-4ba9-85c6-5b7dedde11ce tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1298 microversion: 2.1 time: 0.137289 May 26 16:55:58.004308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c17d9d88-4520-46c6-8823-8701bb12bd31 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:58.004861 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 153/294] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:57 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1298 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:55:58.005717 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c17d9d88-4520-46c6-8823-8701bb12bd31 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:58.007332 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c17d9d88-4520-46c6-8823-8701bb12bd31 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:58.243540 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c17d9d88-4520-46c6-8823-8701bb12bd31 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:58.253855 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c17d9d88-4520-46c6-8823-8701bb12bd31 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:58.256050 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c17d9d88-4520-46c6-8823-8701bb12bd31 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:58.257640 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c17d9d88-4520-46c6-8823-8701bb12bd31 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.272349 May 26 16:55:58.264066 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 142/295] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:55:57 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:55:58.367788 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-67bac0e7-1197-4d45-a520-de95df5a955a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:58.368400 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-67bac0e7-1197-4d45-a520-de95df5a955a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:58.378485 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-67bac0e7-1197-4d45-a520-de95df5a955a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:58.379286 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-67bac0e7-1197-4d45-a520-de95df5a955a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:58.380718 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-67bac0e7-1197-4d45-a520-de95df5a955a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:58.381638 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-67bac0e7-1197-4d45-a520-de95df5a955a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:58.602555 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-67bac0e7-1197-4d45-a520-de95df5a955a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:58.610915 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-67bac0e7-1197-4d45-a520-de95df5a955a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1313 microversion: 2.1 time: 0.247062 May 26 16:55:58.611504 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 154/296] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:58 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:59.029932 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8c3b4488-69eb-4765-989c-835d996ff902 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:59.031055 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8c3b4488-69eb-4765-989c-835d996ff902 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:59.043216 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8c3b4488-69eb-4765-989c-835d996ff902 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:59.044543 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8c3b4488-69eb-4765-989c-835d996ff902 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:59.046212 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8c3b4488-69eb-4765-989c-835d996ff902 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:59.047113 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8c3b4488-69eb-4765-989c-835d996ff902 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:59.141101 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8c3b4488-69eb-4765-989c-835d996ff902 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:59.144559 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:59.151781 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-d6939ec3-4212-47e2-8f01-897f2daf4ff8 req-066c3d8e-9072-4693-be35-1539b485ca14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0e5df4-33a2-4d03-8f86-c68743d1dbba", "name": "network-vif-plugged", "status": "completed", "tag": "b7bfafc7-59b7-4831-81be-c5ef5e045f41"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:55:59.152757 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8c3b4488-69eb-4765-989c-835d996ff902 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1304 microversion: 2.1 time: 0.130791 May 26 16:55:59.153749 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 143/297] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:59 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:55:59.176872 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-d6939ec3-4212-47e2-8f01-897f2daf4ff8 req-066c3d8e-9072-4693-be35-1539b485ca14 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:59.178487 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-d6939ec3-4212-47e2-8f01-897f2daf4ff8 req-066c3d8e-9072-4693-be35-1539b485ca14 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:59.208497 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-d6939ec3-4212-47e2-8f01-897f2daf4ff8 req-066c3d8e-9072-4693-be35-1539b485ca14 service nova] Creating event network-vif-plugged:b7bfafc7-59b7-4831-81be-c5ef5e045f41 for instance 1a0e5df4-33a2-4d03-8f86-c68743d1dbba on hv-cinder-83607 May 26 16:55:59.218917 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-d6939ec3-4212-47e2-8f01-897f2daf4ff8 req-066c3d8e-9072-4693-be35-1539b485ca14 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082039 May 26 16:55:59.220511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 155/298] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:55:59.281795 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-962ebd3c-0059-43e2-853a-5714b9df2de4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:59.282692 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-962ebd3c-0059-43e2-853a-5714b9df2de4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:59.292536 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-962ebd3c-0059-43e2-853a-5714b9df2de4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:59.293305 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-962ebd3c-0059-43e2-853a-5714b9df2de4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:59.294329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-962ebd3c-0059-43e2-853a-5714b9df2de4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:59.295104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-962ebd3c-0059-43e2-853a-5714b9df2de4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:59.495180 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-962ebd3c-0059-43e2-853a-5714b9df2de4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:59.505651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-962ebd3c-0059-43e2-853a-5714b9df2de4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:59.509227 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-962ebd3c-0059-43e2-853a-5714b9df2de4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:59.509227 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-962ebd3c-0059-43e2-853a-5714b9df2de4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.232160 May 26 16:55:59.509227 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 144/299] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:55:59 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:55:59.655205 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-df39f36b-8611-40c4-a020-2d18f68727ff tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:55:59.655380 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-df39f36b-8611-40c4-a020-2d18f68727ff tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:55:59.665076 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-df39f36b-8611-40c4-a020-2d18f68727ff tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:59.665649 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-df39f36b-8611-40c4-a020-2d18f68727ff tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:59.666559 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-df39f36b-8611-40c4-a020-2d18f68727ff tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:55:59.667093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-df39f36b-8611-40c4-a020-2d18f68727ff tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:55:59.862889 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-df39f36b-8611-40c4-a020-2d18f68727ff tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:55:59.878059 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-df39f36b-8611-40c4-a020-2d18f68727ff tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1313 microversion: 2.1 time: 0.242980 May 26 16:55:59.879013 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 156/300] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:55:59 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:56:00.175498 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-853e2f5d-8753-4d98-af35-5cba1a6a977b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:00.176453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-853e2f5d-8753-4d98-af35-5cba1a6a977b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:00.188737 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-853e2f5d-8753-4d98-af35-5cba1a6a977b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:00.189470 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-853e2f5d-8753-4d98-af35-5cba1a6a977b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:00.195402 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-853e2f5d-8753-4d98-af35-5cba1a6a977b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:00.195402 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-853e2f5d-8753-4d98-af35-5cba1a6a977b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:00.368172 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-853e2f5d-8753-4d98-af35-5cba1a6a977b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:00.377668 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-853e2f5d-8753-4d98-af35-5cba1a6a977b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1371 microversion: 2.1 time: 0.209033 May 26 16:56:00.378369 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 145/301] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:00 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:00.530362 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-073977b8-80f0-4804-bfb4-172c33e6b923 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:00.531428 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-073977b8-80f0-4804-bfb4-172c33e6b923 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:00.544692 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-073977b8-80f0-4804-bfb4-172c33e6b923 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:00.545419 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-073977b8-80f0-4804-bfb4-172c33e6b923 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:00.547122 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-073977b8-80f0-4804-bfb4-172c33e6b923 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:00.550086 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-073977b8-80f0-4804-bfb4-172c33e6b923 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:00.749637 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-073977b8-80f0-4804-bfb4-172c33e6b923 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:00.759928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-073977b8-80f0-4804-bfb4-172c33e6b923 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:00.761834 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-073977b8-80f0-4804-bfb4-172c33e6b923 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:00.763463 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-073977b8-80f0-4804-bfb4-172c33e6b923 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.237504 May 26 16:56:00.764322 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 157/302] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:00 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:00.902982 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a1cfaa78-7512-477c-b1bc-575fef7c7e0f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:00.904039 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a1cfaa78-7512-477c-b1bc-575fef7c7e0f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:00.915533 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a1cfaa78-7512-477c-b1bc-575fef7c7e0f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:00.916526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a1cfaa78-7512-477c-b1bc-575fef7c7e0f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:00.918193 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a1cfaa78-7512-477c-b1bc-575fef7c7e0f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:00.918990 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a1cfaa78-7512-477c-b1bc-575fef7c7e0f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:01.109050 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a1cfaa78-7512-477c-b1bc-575fef7c7e0f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:01.121492 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a1cfaa78-7512-477c-b1bc-575fef7c7e0f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1313 microversion: 2.1 time: 0.227349 May 26 16:56:01.122514 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 146/303] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:00 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:01.396684 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-17c8bc29-de8f-453e-9bca-419ffead05ac tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:01.397711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-17c8bc29-de8f-453e-9bca-419ffead05ac tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:01.415948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-17c8bc29-de8f-453e-9bca-419ffead05ac tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:01.421617 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-17c8bc29-de8f-453e-9bca-419ffead05ac tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:01.422686 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-17c8bc29-de8f-453e-9bca-419ffead05ac tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:01.423253 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-17c8bc29-de8f-453e-9bca-419ffead05ac tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:01.613462 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-17c8bc29-de8f-453e-9bca-419ffead05ac tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:01.623274 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-17c8bc29-de8f-453e-9bca-419ffead05ac tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1371 microversion: 2.1 time: 0.230534 May 26 16:56:01.624331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 158/304] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:01 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:01.801816 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9ad5e9ac-9e30-48a4-98a8-52dea3e50538 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:01.806309 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9ad5e9ac-9e30-48a4-98a8-52dea3e50538 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:01.814489 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=4 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:01.820692 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ad5e9ac-9e30-48a4-98a8-52dea3e50538 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:01.823155 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ad5e9ac-9e30-48a4-98a8-52dea3e50538 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:01.823966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ad5e9ac-9e30-48a4-98a8-52dea3e50538 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:01.824417 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ad5e9ac-9e30-48a4-98a8-52dea3e50538 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:02.151078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1e2b9dc3-5d07-4e57-8910-d6f301424fa3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:02.152098 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1e2b9dc3-5d07-4e57-8910-d6f301424fa3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:02.171647 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1e2b9dc3-5d07-4e57-8910-d6f301424fa3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:02.172951 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1e2b9dc3-5d07-4e57-8910-d6f301424fa3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:02.175262 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1e2b9dc3-5d07-4e57-8910-d6f301424fa3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:02.192164 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1e2b9dc3-5d07-4e57-8910-d6f301424fa3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:02.403004 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9ad5e9ac-9e30-48a4-98a8-52dea3e50538 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:02.432263 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9ad5e9ac-9e30-48a4-98a8-52dea3e50538 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:02.433828 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9ad5e9ac-9e30-48a4-98a8-52dea3e50538 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:02.435249 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9ad5e9ac-9e30-48a4-98a8-52dea3e50538 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.645383 May 26 16:56:02.436017 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 147/305] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:01 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:02.645387 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1e2b9dc3-5d07-4e57-8910-d6f301424fa3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:02.649899 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0cd6f61e-f5a8-43b9-9d42-dea69bda3359 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:02.652399 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0cd6f61e-f5a8-43b9-9d42-dea69bda3359 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:02.667266 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-1e2b9dc3-5d07-4e57-8910-d6f301424fa3 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1496 microversion: 2.1 time: 0.522802 May 26 16:56:02.671079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0cd6f61e-f5a8-43b9-9d42-dea69bda3359 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:02.671230 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 159/306] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:02 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1496 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:02.671325 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0cd6f61e-f5a8-43b9-9d42-dea69bda3359 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:02.671756 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0cd6f61e-f5a8-43b9-9d42-dea69bda3359 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:02.672392 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0cd6f61e-f5a8-43b9-9d42-dea69bda3359 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:02.935636 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0cd6f61e-f5a8-43b9-9d42-dea69bda3359 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:02.954591 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0cd6f61e-f5a8-43b9-9d42-dea69bda3359 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1371 microversion: 2.1 time: 0.315282 May 26 16:56:02.956667 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 148/307] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:02 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:02.984378 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-d56621e1-076c-489a-bf6c-849460375ced req-e282f6eb-807e-4cf0-9f0f-6803e49c3755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8efc5100-c116-4608-a1d9-26e418e0609e", "tag": "3477b3a3-f453-4aca-9e4e-a3d0795c1473"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:02.996525 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-d56621e1-076c-489a-bf6c-849460375ced req-e282f6eb-807e-4cf0-9f0f-6803e49c3755 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:02.997191 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-d56621e1-076c-489a-bf6c-849460375ced req-e282f6eb-807e-4cf0-9f0f-6803e49c3755 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:03.014238 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-d56621e1-076c-489a-bf6c-849460375ced req-e282f6eb-807e-4cf0-9f0f-6803e49c3755 service nova] Creating event network-changed:3477b3a3-f453-4aca-9e4e-a3d0795c1473 for instance 8efc5100-c116-4608-a1d9-26e418e0609e on hv-cinder-83607 May 26 16:56:03.027716 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-d56621e1-076c-489a-bf6c-849460375ced req-e282f6eb-807e-4cf0-9f0f-6803e49c3755 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055880 May 26 16:56:03.030730 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 160/308] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:56:03.453682 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4bdeb1e1-2225-4a1f-8ed2-6c8f0bdb8414 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:03.454618 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4bdeb1e1-2225-4a1f-8ed2-6c8f0bdb8414 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:03.461225 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4bdeb1e1-2225-4a1f-8ed2-6c8f0bdb8414 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:03.462059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4bdeb1e1-2225-4a1f-8ed2-6c8f0bdb8414 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:03.463096 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4bdeb1e1-2225-4a1f-8ed2-6c8f0bdb8414 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:03.463743 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4bdeb1e1-2225-4a1f-8ed2-6c8f0bdb8414 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:03.691495 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4bdeb1e1-2225-4a1f-8ed2-6c8f0bdb8414 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:03.713017 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4bdeb1e1-2225-4a1f-8ed2-6c8f0bdb8414 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:03.714697 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4bdeb1e1-2225-4a1f-8ed2-6c8f0bdb8414 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:03.715833 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4bdeb1e1-2225-4a1f-8ed2-6c8f0bdb8414 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.266187 May 26 16:56:03.718445 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 149/309] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:03 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:56:03.807610 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-99f2ee60-1fd4-4d09-9133-99ac9f410b77 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:03.817678 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-99f2ee60-1fd4-4d09-9133-99ac9f410b77 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:03.818207 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-99f2ee60-1fd4-4d09-9133-99ac9f410b77 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:03.899309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-99f2ee60-1fd4-4d09-9133-99ac9f410b77 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Going to try to stop instance {{(pid=124836) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 16:56:03.982322 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c4b2ecf4-2b39-430e-bd78-bb26026b1c6f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:03.982955 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c4b2ecf4-2b39-430e-bd78-bb26026b1c6f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:03.989820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c4b2ecf4-2b39-430e-bd78-bb26026b1c6f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:03.990299 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c4b2ecf4-2b39-430e-bd78-bb26026b1c6f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:03.991593 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c4b2ecf4-2b39-430e-bd78-bb26026b1c6f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:03.992049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c4b2ecf4-2b39-430e-bd78-bb26026b1c6f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:04.216179 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-99f2ee60-1fd4-4d09-9133-99ac9f410b77 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "POST /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/action" status: 202 len: 0 microversion: 2.1 time: 0.416149 May 26 16:56:04.217617 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 161/310] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 26 16:56:03 2022] POST /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:56:04.231272 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-bcd7f131-a1ee-4ea5-8118-c7a64db7cfa2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:04.233222 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-bcd7f131-a1ee-4ea5-8118-c7a64db7cfa2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:04.241905 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bcd7f131-a1ee-4ea5-8118-c7a64db7cfa2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:04.242956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bcd7f131-a1ee-4ea5-8118-c7a64db7cfa2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:04.244312 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bcd7f131-a1ee-4ea5-8118-c7a64db7cfa2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:04.245040 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bcd7f131-a1ee-4ea5-8118-c7a64db7cfa2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:04.260451 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c4b2ecf4-2b39-430e-bd78-bb26026b1c6f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:04.295031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c4b2ecf4-2b39-430e-bd78-bb26026b1c6f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1371 microversion: 2.1 time: 0.316139 May 26 16:56:04.297007 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 150/311] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:03 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1371 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:56:04.676786 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-bcd7f131-a1ee-4ea5-8118-c7a64db7cfa2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:04.686894 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-bcd7f131-a1ee-4ea5-8118-c7a64db7cfa2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.463730 May 26 16:56:04.690683 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 162/312] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:04 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:04.771846 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b1349103-3f63-4b88-bbf9-94fd8a7ca45c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:04.779587 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b1349103-3f63-4b88-bbf9-94fd8a7ca45c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:04.798681 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b1349103-3f63-4b88-bbf9-94fd8a7ca45c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:04.799841 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b1349103-3f63-4b88-bbf9-94fd8a7ca45c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:04.810116 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b1349103-3f63-4b88-bbf9-94fd8a7ca45c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:04.817123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b1349103-3f63-4b88-bbf9-94fd8a7ca45c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:05.063764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b1349103-3f63-4b88-bbf9-94fd8a7ca45c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:05.106877 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b1349103-3f63-4b88-bbf9-94fd8a7ca45c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:05.109793 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b1349103-3f63-4b88-bbf9-94fd8a7ca45c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:05.111897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b1349103-3f63-4b88-bbf9-94fd8a7ca45c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.359808 May 26 16:56:05.113067 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 151/313] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:04 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:05.332075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c9f2cfe4-2b6c-40de-8203-06e7e380112a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:05.334291 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c9f2cfe4-2b6c-40de-8203-06e7e380112a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:05.340662 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:05.351918 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c9f2cfe4-2b6c-40de-8203-06e7e380112a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:05.353207 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c9f2cfe4-2b6c-40de-8203-06e7e380112a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:05.355076 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c9f2cfe4-2b6c-40de-8203-06e7e380112a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:05.357523 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c9f2cfe4-2b6c-40de-8203-06e7e380112a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:05.673138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c9f2cfe4-2b6c-40de-8203-06e7e380112a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:05.691271 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c9f2cfe4-2b6c-40de-8203-06e7e380112a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1371 microversion: 2.1 time: 0.363224 May 26 16:56:05.692285 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 163/314] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:05 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1371 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:05.722813 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-35bf37c7-e171-43c5-adc1-04769c794810 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:05.723931 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-35bf37c7-e171-43c5-adc1-04769c794810 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:05.733277 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-35bf37c7-e171-43c5-adc1-04769c794810 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:05.742677 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-35bf37c7-e171-43c5-adc1-04769c794810 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:05.743921 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-35bf37c7-e171-43c5-adc1-04769c794810 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:05.744371 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-35bf37c7-e171-43c5-adc1-04769c794810 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:06.073962 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-35bf37c7-e171-43c5-adc1-04769c794810 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:06.102889 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-35bf37c7-e171-43c5-adc1-04769c794810 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.387857 May 26 16:56:06.104746 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 152/315] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:05 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:06.141604 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-549ca933-f894-46d8-ba78-a28f8b8e3f8d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:06.142899 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-549ca933-f894-46d8-ba78-a28f8b8e3f8d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:06.153223 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=8 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:06.166489 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-549ca933-f894-46d8-ba78-a28f8b8e3f8d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:06.166489 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-549ca933-f894-46d8-ba78-a28f8b8e3f8d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:06.167397 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-549ca933-f894-46d8-ba78-a28f8b8e3f8d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:06.169616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-549ca933-f894-46d8-ba78-a28f8b8e3f8d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:06.542119 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-549ca933-f894-46d8-ba78-a28f8b8e3f8d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:06.554265 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-549ca933-f894-46d8-ba78-a28f8b8e3f8d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:06.556873 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-549ca933-f894-46d8-ba78-a28f8b8e3f8d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:06.559766 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-549ca933-f894-46d8-ba78-a28f8b8e3f8d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.431005 May 26 16:56:06.561453 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 164/316] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:06 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:56:06.716687 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-91a71fa6-5f03-4db1-adc1-e759d9b227d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:06.717835 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-91a71fa6-5f03-4db1-adc1-e759d9b227d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:06.745418 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91a71fa6-5f03-4db1-adc1-e759d9b227d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:06.747788 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91a71fa6-5f03-4db1-adc1-e759d9b227d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:06.751555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91a71fa6-5f03-4db1-adc1-e759d9b227d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:06.754480 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91a71fa6-5f03-4db1-adc1-e759d9b227d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:07.057125 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-91a71fa6-5f03-4db1-adc1-e759d9b227d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:07.082187 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-91a71fa6-5f03-4db1-adc1-e759d9b227d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1371 microversion: 2.1 time: 0.368063 May 26 16:56:07.086053 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 153/317] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:06 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1371 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:07.130302 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-89da71aa-8103-468f-aba4-ad4e84f6d517 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:07.131328 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-89da71aa-8103-468f-aba4-ad4e84f6d517 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:07.139936 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-89da71aa-8103-468f-aba4-ad4e84f6d517 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:07.140852 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-89da71aa-8103-468f-aba4-ad4e84f6d517 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:07.142140 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-89da71aa-8103-468f-aba4-ad4e84f6d517 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:07.142830 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-89da71aa-8103-468f-aba4-ad4e84f6d517 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:07.168777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:07.323950 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-89da71aa-8103-468f-aba4-ad4e84f6d517 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:07.339202 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-89da71aa-8103-468f-aba4-ad4e84f6d517 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.212951 May 26 16:56:07.340706 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 165/318] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:07 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:07.586893 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1b7e2458-2ef2-4829-a7e8-f84e03d74a00 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:07.588418 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1b7e2458-2ef2-4829-a7e8-f84e03d74a00 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:07.600622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b7e2458-2ef2-4829-a7e8-f84e03d74a00 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:07.602048 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b7e2458-2ef2-4829-a7e8-f84e03d74a00 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:07.603593 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b7e2458-2ef2-4829-a7e8-f84e03d74a00 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:07.604475 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b7e2458-2ef2-4829-a7e8-f84e03d74a00 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:07.845806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1b7e2458-2ef2-4829-a7e8-f84e03d74a00 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:07.859971 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1b7e2458-2ef2-4829-a7e8-f84e03d74a00 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:07.868091 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1b7e2458-2ef2-4829-a7e8-f84e03d74a00 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:07.869378 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1b7e2458-2ef2-4829-a7e8-f84e03d74a00 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.291930 May 26 16:56:07.874812 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 154/319] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:07 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:07.978024 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-fd4961d4-70d1-4a43-9e3f-097c5e932afb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:07.979414 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-fd4961d4-70d1-4a43-9e3f-097c5e932afb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:07.993212 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fd4961d4-70d1-4a43-9e3f-097c5e932afb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:07.994071 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fd4961d4-70d1-4a43-9e3f-097c5e932afb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:07.995324 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fd4961d4-70d1-4a43-9e3f-097c5e932afb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:07.996275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fd4961d4-70d1-4a43-9e3f-097c5e932afb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:08.048619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-fd4961d4-70d1-4a43-9e3f-097c5e932afb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Going to try to terminate instance {{(pid=124836) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:56:08.098325 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ec2b3094-62cb-46a8-868e-fb0fd8bc70d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:08.100489 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ec2b3094-62cb-46a8-868e-fb0fd8bc70d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:08.108846 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ec2b3094-62cb-46a8-868e-fb0fd8bc70d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:08.109803 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ec2b3094-62cb-46a8-868e-fb0fd8bc70d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:08.111648 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ec2b3094-62cb-46a8-868e-fb0fd8bc70d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:08.112394 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ec2b3094-62cb-46a8-868e-fb0fd8bc70d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:08.268159 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ec2b3094-62cb-46a8-868e-fb0fd8bc70d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:08.280546 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ec2b3094-62cb-46a8-868e-fb0fd8bc70d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1371 microversion: 2.1 time: 0.185974 May 26 16:56:08.281588 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 155/320] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:08 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:56:08.362236 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e58c8281-4b3f-4495-93a6-007d34995968 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:08.362236 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e58c8281-4b3f-4495-93a6-007d34995968 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:08.369304 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e58c8281-4b3f-4495-93a6-007d34995968 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:08.370173 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e58c8281-4b3f-4495-93a6-007d34995968 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:08.371376 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e58c8281-4b3f-4495-93a6-007d34995968 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:08.372172 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e58c8281-4b3f-4495-93a6-007d34995968 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:08.637464 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-fd4961d4-70d1-4a43-9e3f-097c5e932afb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 204 len: 0 microversion: 2.1 time: 0.657019 May 26 16:56:08.638427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 166/321] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 16:56:07 2022] DELETE /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 0 bytes in 662 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:56:08.658735 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e58c8281-4b3f-4495-93a6-007d34995968 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:08.660971 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-be904fda-42ac-4a0e-bb2e-11cccab242af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:08.662812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-be904fda-42ac-4a0e-bb2e-11cccab242af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:08.690930 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e58c8281-4b3f-4495-93a6-007d34995968 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.334864 May 26 16:56:08.693806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 156/322] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:08 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:56:08.705830 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-be904fda-42ac-4a0e-bb2e-11cccab242af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:08.710791 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-be904fda-42ac-4a0e-bb2e-11cccab242af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:08.714684 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-be904fda-42ac-4a0e-bb2e-11cccab242af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:08.748295 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-be904fda-42ac-4a0e-bb2e-11cccab242af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:08.908028 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b45d91e8-0790-447d-94c4-b26f9080c546 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:08.908784 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b45d91e8-0790-447d-94c4-b26f9080c546 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:08.945354 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b45d91e8-0790-447d-94c4-b26f9080c546 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:08.948904 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b45d91e8-0790-447d-94c4-b26f9080c546 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:08.952250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b45d91e8-0790-447d-94c4-b26f9080c546 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:08.953671 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b45d91e8-0790-447d-94c4-b26f9080c546 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:09.421868 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-be904fda-42ac-4a0e-bb2e-11cccab242af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:09.438878 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-be904fda-42ac-4a0e-bb2e-11cccab242af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1502 microversion: 2.1 time: 0.791744 May 26 16:56:09.439801 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 167/323] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:08 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1502 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:09.448831 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c0e2b709-ce91-4cf9-9354-9bf22f470b42 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:09.450761 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c0e2b709-ce91-4cf9-9354-9bf22f470b42 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:09.469530 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c0e2b709-ce91-4cf9-9354-9bf22f470b42 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:09.470244 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c0e2b709-ce91-4cf9-9354-9bf22f470b42 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:09.471247 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c0e2b709-ce91-4cf9-9354-9bf22f470b42 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:09.472072 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b45d91e8-0790-447d-94c4-b26f9080c546 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:09.472833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c0e2b709-ce91-4cf9-9354-9bf22f470b42 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:09.489062 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b45d91e8-0790-447d-94c4-b26f9080c546 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:09.493300 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b45d91e8-0790-447d-94c4-b26f9080c546 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:09.496022 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b45d91e8-0790-447d-94c4-b26f9080c546 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.594236 May 26 16:56:09.497409 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 157/324] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:08 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:09.689100 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c0e2b709-ce91-4cf9-9354-9bf22f470b42 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:09.704654 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c0e2b709-ce91-4cf9-9354-9bf22f470b42 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1371 microversion: 2.1 time: 0.262804 May 26 16:56:09.705742 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 168/325] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:09 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1371 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:09.730871 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c03be83c-aea5-4e6d-a80a-12b77b1604fd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:09.732209 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c03be83c-aea5-4e6d-a80a-12b77b1604fd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:09.744063 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c03be83c-aea5-4e6d-a80a-12b77b1604fd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:09.746041 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c03be83c-aea5-4e6d-a80a-12b77b1604fd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:09.747874 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c03be83c-aea5-4e6d-a80a-12b77b1604fd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:09.749008 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c03be83c-aea5-4e6d-a80a-12b77b1604fd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:09.966313 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c03be83c-aea5-4e6d-a80a-12b77b1604fd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:09.979226 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c03be83c-aea5-4e6d-a80a-12b77b1604fd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.259436 May 26 16:56:09.990869 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 158/326] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:09 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:10.457636 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c7d909f2-df5f-45c9-9a19-89459a51e9fa tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:10.458355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c7d909f2-df5f-45c9-9a19-89459a51e9fa tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:10.472329 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c7d909f2-df5f-45c9-9a19-89459a51e9fa tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:10.476292 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c7d909f2-df5f-45c9-9a19-89459a51e9fa tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:10.478183 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c7d909f2-df5f-45c9-9a19-89459a51e9fa tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:10.479024 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c7d909f2-df5f-45c9-9a19-89459a51e9fa tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:10.529332 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e5564a68-243e-4e1e-9160-4cae1bfdb72d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:10.530114 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e5564a68-243e-4e1e-9160-4cae1bfdb72d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:10.544141 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e5564a68-243e-4e1e-9160-4cae1bfdb72d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:10.545125 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e5564a68-243e-4e1e-9160-4cae1bfdb72d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:10.546152 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e5564a68-243e-4e1e-9160-4cae1bfdb72d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:10.546775 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e5564a68-243e-4e1e-9160-4cae1bfdb72d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:10.797822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c7d909f2-df5f-45c9-9a19-89459a51e9fa tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:10.816819 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c7d909f2-df5f-45c9-9a19-89459a51e9fa tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1502 microversion: 2.1 time: 0.354252 May 26 16:56:10.816819 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 169/327] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:10 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1502 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:56:10.816819 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5d861636-ccae-4f00-82b7-6c8807a5b72e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:10.816819 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5d861636-ccae-4f00-82b7-6c8807a5b72e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:10.834036 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d861636-ccae-4f00-82b7-6c8807a5b72e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:10.834679 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d861636-ccae-4f00-82b7-6c8807a5b72e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:10.836898 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d861636-ccae-4f00-82b7-6c8807a5b72e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:10.837563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d861636-ccae-4f00-82b7-6c8807a5b72e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:10.877439 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e5564a68-243e-4e1e-9160-4cae1bfdb72d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:10.895500 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e5564a68-243e-4e1e-9160-4cae1bfdb72d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:10.898603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e5564a68-243e-4e1e-9160-4cae1bfdb72d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:10.900284 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e5564a68-243e-4e1e-9160-4cae1bfdb72d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.375309 May 26 16:56:10.901334 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 159/328] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:10 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:10.997499 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b7d33c3a-1fae-4f0c-8048-8d69de9f7065 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:10.998536 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b7d33c3a-1fae-4f0c-8048-8d69de9f7065 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:11.006068 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7d33c3a-1fae-4f0c-8048-8d69de9f7065 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:11.007387 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7d33c3a-1fae-4f0c-8048-8d69de9f7065 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:11.008418 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7d33c3a-1fae-4f0c-8048-8d69de9f7065 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:11.009109 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b7d33c3a-1fae-4f0c-8048-8d69de9f7065 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:11.027180 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:11.070769 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5d861636-ccae-4f00-82b7-6c8807a5b72e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:11.095427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5d861636-ccae-4f00-82b7-6c8807a5b72e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1371 microversion: 2.1 time: 0.284371 May 26 16:56:11.096436 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 170/329] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:10 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1371 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:11.325829 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b7d33c3a-1fae-4f0c-8048-8d69de9f7065 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:11.338803 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b7d33c3a-1fae-4f0c-8048-8d69de9f7065 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.345291 May 26 16:56:11.340553 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 160/330] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:10 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:11.837612 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e32a7a7b-1bf7-45e2-b1b7-44fe28152b98 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:11.838643 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e32a7a7b-1bf7-45e2-b1b7-44fe28152b98 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:11.849936 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e32a7a7b-1bf7-45e2-b1b7-44fe28152b98 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:11.851369 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e32a7a7b-1bf7-45e2-b1b7-44fe28152b98 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:11.853760 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e32a7a7b-1bf7-45e2-b1b7-44fe28152b98 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:11.855391 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e32a7a7b-1bf7-45e2-b1b7-44fe28152b98 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:11.919932 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ac6cb5ef-5266-44a5-8b55-da7735f6000f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:11.920846 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ac6cb5ef-5266-44a5-8b55-da7735f6000f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:11.940349 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac6cb5ef-5266-44a5-8b55-da7735f6000f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:11.940349 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac6cb5ef-5266-44a5-8b55-da7735f6000f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:11.940349 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac6cb5ef-5266-44a5-8b55-da7735f6000f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:11.940349 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ac6cb5ef-5266-44a5-8b55-da7735f6000f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:12.317139 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e32a7a7b-1bf7-45e2-b1b7-44fe28152b98 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:12.348702 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e32a7a7b-1bf7-45e2-b1b7-44fe28152b98 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1502 microversion: 2.1 time: 0.516455 May 26 16:56:12.350796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 171/331] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:11 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1502 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:56:12.357572 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-fb37c180-f64d-4362-9aec-db5f7097c53c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:12.358336 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-fb37c180-f64d-4362-9aec-db5f7097c53c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:12.378960 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fb37c180-f64d-4362-9aec-db5f7097c53c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:12.382294 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fb37c180-f64d-4362-9aec-db5f7097c53c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:12.382294 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fb37c180-f64d-4362-9aec-db5f7097c53c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:12.382294 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fb37c180-f64d-4362-9aec-db5f7097c53c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:12.475506 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ac6cb5ef-5266-44a5-8b55-da7735f6000f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:12.485339 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ac6cb5ef-5266-44a5-8b55-da7735f6000f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:12.487117 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ac6cb5ef-5266-44a5-8b55-da7735f6000f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:12.488660 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ac6cb5ef-5266-44a5-8b55-da7735f6000f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.572794 May 26 16:56:12.489306 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 161/332] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:11 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:56:12.495735 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-07bf3bf4-63d9-46f8-9d22-0b3122d2f0c1 req-e9d6aac8-2a3d-4b0d-845d-1ab18698a9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0e5df4-33a2-4d03-8f86-c68743d1dbba", "name": "network-vif-deleted", "tag": "b7bfafc7-59b7-4831-81be-c5ef5e045f41"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:12.508476 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-07bf3bf4-63d9-46f8-9d22-0b3122d2f0c1 req-e9d6aac8-2a3d-4b0d-845d-1ab18698a9bb service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:12.509288 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-07bf3bf4-63d9-46f8-9d22-0b3122d2f0c1 req-e9d6aac8-2a3d-4b0d-845d-1ab18698a9bb service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:12.530889 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-07bf3bf4-63d9-46f8-9d22-0b3122d2f0c1 req-e9d6aac8-2a3d-4b0d-845d-1ab18698a9bb service nova] Creating event network-vif-deleted:b7bfafc7-59b7-4831-81be-c5ef5e045f41 for instance 1a0e5df4-33a2-4d03-8f86-c68743d1dbba on hv-cinder-83607 May 26 16:56:12.538638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-07bf3bf4-63d9-46f8-9d22-0b3122d2f0c1 req-e9d6aac8-2a3d-4b0d-845d-1ab18698a9bb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047441 May 26 16:56:12.539779 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 162/333] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:56:12.546391 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-dcfbeff2-8157-4fb5-9617-5674b94b115d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:12.546840 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-dcfbeff2-8157-4fb5-9617-5674b94b115d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:12.554947 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dcfbeff2-8157-4fb5-9617-5674b94b115d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:12.555402 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dcfbeff2-8157-4fb5-9617-5674b94b115d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:12.556190 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dcfbeff2-8157-4fb5-9617-5674b94b115d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:12.556628 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dcfbeff2-8157-4fb5-9617-5674b94b115d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:13.048994 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-fb37c180-f64d-4362-9aec-db5f7097c53c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:13.073954 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-fb37c180-f64d-4362-9aec-db5f7097c53c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1371 microversion: 2.1 time: 0.717638 May 26 16:56:13.075442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 172/334] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:12 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1371 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:13.087632 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-dcfbeff2-8157-4fb5-9617-5674b94b115d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:13.101587 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-dcfbeff2-8157-4fb5-9617-5674b94b115d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.558828 May 26 16:56:13.105816 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 163/335] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:12 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:13.374546 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-90f47c83-66e3-4f4b-b0f2-815f6b0aecd1 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:13.375417 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-90f47c83-66e3-4f4b-b0f2-815f6b0aecd1 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:13.385044 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-90f47c83-66e3-4f4b-b0f2-815f6b0aecd1 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:13.385520 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-90f47c83-66e3-4f4b-b0f2-815f6b0aecd1 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:13.386999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-90f47c83-66e3-4f4b-b0f2-815f6b0aecd1 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:13.387824 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-90f47c83-66e3-4f4b-b0f2-815f6b0aecd1 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:13.449341 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-90f47c83-66e3-4f4b-b0f2-815f6b0aecd1 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:13.450279 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-90f47c83-66e3-4f4b-b0f2-815f6b0aecd1 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:13.453421 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-90f47c83-66e3-4f4b-b0f2-815f6b0aecd1 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lazy-loading 'fault' on Instance uuid 1a0e5df4-33a2-4d03-8f86-c68743d1dbba {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:56:13.518724 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c816b334-12e6-4848-b5ea-2f5eecb65a04 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:13.519409 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c816b334-12e6-4848-b5ea-2f5eecb65a04 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:13.524740 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-90f47c83-66e3-4f4b-b0f2-815f6b0aecd1 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:13.528946 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c816b334-12e6-4848-b5ea-2f5eecb65a04 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:13.529548 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c816b334-12e6-4848-b5ea-2f5eecb65a04 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:13.530577 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c816b334-12e6-4848-b5ea-2f5eecb65a04 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:13.531031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c816b334-12e6-4848-b5ea-2f5eecb65a04 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:13.540378 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-90f47c83-66e3-4f4b-b0f2-815f6b0aecd1 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1303 microversion: 2.1 time: 0.169319 May 26 16:56:13.542761 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 173/336] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:13 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1303 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:13.777094 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c816b334-12e6-4848-b5ea-2f5eecb65a04 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:13.797575 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c816b334-12e6-4848-b5ea-2f5eecb65a04 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:13.805176 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c816b334-12e6-4848-b5ea-2f5eecb65a04 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:13.809794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c816b334-12e6-4848-b5ea-2f5eecb65a04 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.293470 May 26 16:56:13.816034 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 164/337] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:13 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:56:14.108488 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-d6313e37-bb02-4808-8a82-298e1779cc9f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:14.109536 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-d6313e37-bb02-4808-8a82-298e1779cc9f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:14.119642 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d6313e37-bb02-4808-8a82-298e1779cc9f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:14.120483 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d6313e37-bb02-4808-8a82-298e1779cc9f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:14.121493 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d6313e37-bb02-4808-8a82-298e1779cc9f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:14.122340 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d6313e37-bb02-4808-8a82-298e1779cc9f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:14.126589 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c90cd40d-2fb3-431b-95a3-5963aa0806c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:14.128880 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c90cd40d-2fb3-431b-95a3-5963aa0806c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:14.142066 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c90cd40d-2fb3-431b-95a3-5963aa0806c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:14.143346 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c90cd40d-2fb3-431b-95a3-5963aa0806c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:14.144802 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c90cd40d-2fb3-431b-95a3-5963aa0806c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:14.146493 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c90cd40d-2fb3-431b-95a3-5963aa0806c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:14.430367 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d6313e37-bb02-4808-8a82-298e1779cc9f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:14.430367 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-d6313e37-bb02-4808-8a82-298e1779cc9f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1371 microversion: 2.1 time: 0.312458 May 26 16:56:14.430367 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 174/338] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:14 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:14.460592 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c90cd40d-2fb3-431b-95a3-5963aa0806c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:14.470371 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c90cd40d-2fb3-431b-95a3-5963aa0806c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.350682 May 26 16:56:14.471231 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 165/339] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:14 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:14.570163 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1cf4d783-095e-41e5-9405-a35f9877f460 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:14.571142 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1cf4d783-095e-41e5-9405-a35f9877f460 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:14.580297 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1cf4d783-095e-41e5-9405-a35f9877f460 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:14.581131 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1cf4d783-095e-41e5-9405-a35f9877f460 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:14.583436 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1cf4d783-095e-41e5-9405-a35f9877f460 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:14.584175 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1cf4d783-095e-41e5-9405-a35f9877f460 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:14.672297 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1cf4d783-095e-41e5-9405-a35f9877f460 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:14.673561 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1cf4d783-095e-41e5-9405-a35f9877f460 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:14.674673 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-1cf4d783-095e-41e5-9405-a35f9877f460 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lazy-loading 'fault' on Instance uuid 1a0e5df4-33a2-4d03-8f86-c68743d1dbba {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:56:14.792430 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1cf4d783-095e-41e5-9405-a35f9877f460 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:14.809096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-1cf4d783-095e-41e5-9405-a35f9877f460 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1303 microversion: 2.1 time: 0.245167 May 26 16:56:14.810239 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 175/340] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:14 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1303 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:14.845996 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d0bafdbb-d1e3-41c6-b4b9-3dc9eee3283a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:14.847582 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d0bafdbb-d1e3-41c6-b4b9-3dc9eee3283a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:14.855377 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0bafdbb-d1e3-41c6-b4b9-3dc9eee3283a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:14.855826 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0bafdbb-d1e3-41c6-b4b9-3dc9eee3283a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:14.856798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0bafdbb-d1e3-41c6-b4b9-3dc9eee3283a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:14.857354 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0bafdbb-d1e3-41c6-b4b9-3dc9eee3283a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:15.062703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d0bafdbb-d1e3-41c6-b4b9-3dc9eee3283a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:15.073929 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d0bafdbb-d1e3-41c6-b4b9-3dc9eee3283a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:15.077010 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d0bafdbb-d1e3-41c6-b4b9-3dc9eee3283a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:15.079048 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d0bafdbb-d1e3-41c6-b4b9-3dc9eee3283a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.238300 May 26 16:56:15.080213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 166/341] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:14 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:56:15.446746 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-80b4d7ad-0591-4cc5-b1a4-04a0e6c920c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:15.450290 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-80b4d7ad-0591-4cc5-b1a4-04a0e6c920c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:15.464229 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-80b4d7ad-0591-4cc5-b1a4-04a0e6c920c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:15.465291 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-80b4d7ad-0591-4cc5-b1a4-04a0e6c920c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:15.475099 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-80b4d7ad-0591-4cc5-b1a4-04a0e6c920c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:15.475099 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-80b4d7ad-0591-4cc5-b1a4-04a0e6c920c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:15.516213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ba9a407a-08fc-4b02-9408-91ba5fd5c2e5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:15.516973 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ba9a407a-08fc-4b02-9408-91ba5fd5c2e5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:15.550466 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ba9a407a-08fc-4b02-9408-91ba5fd5c2e5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:15.558975 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ba9a407a-08fc-4b02-9408-91ba5fd5c2e5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:15.560387 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ba9a407a-08fc-4b02-9408-91ba5fd5c2e5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:15.568104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ba9a407a-08fc-4b02-9408-91ba5fd5c2e5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:15.985757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-80b4d7ad-0591-4cc5-b1a4-04a0e6c920c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:15.991600 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ba9a407a-08fc-4b02-9408-91ba5fd5c2e5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:16.002600 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ba9a407a-08fc-4b02-9408-91ba5fd5c2e5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.508822 May 26 16:56:16.019902 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-80b4d7ad-0591-4cc5-b1a4-04a0e6c920c8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1371 microversion: 2.1 time: 0.567973 May 26 16:56:16.020411 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 167/342] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:15 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:16.026138 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f7b6ffde-a143-481f-aa12-0b8539b76424 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:16.027306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 176/343] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:15 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1371 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:16.027653 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f7b6ffde-a143-481f-aa12-0b8539b76424 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:16.036218 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7b6ffde-a143-481f-aa12-0b8539b76424 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:16.037448 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7b6ffde-a143-481f-aa12-0b8539b76424 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:16.039553 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7b6ffde-a143-481f-aa12-0b8539b76424 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:16.040252 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7b6ffde-a143-481f-aa12-0b8539b76424 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:16.102220 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-26b82618-52ea-4bf0-a1d7-d038d3bb8238 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:16.103155 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-26b82618-52ea-4bf0-a1d7-d038d3bb8238 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:16.103587 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7b6ffde-a143-481f-aa12-0b8539b76424 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:16.104300 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7b6ffde-a143-481f-aa12-0b8539b76424 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:16.105001 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-f7b6ffde-a143-481f-aa12-0b8539b76424 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lazy-loading 'fault' on Instance uuid 1a0e5df4-33a2-4d03-8f86-c68743d1dbba {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:56:16.125535 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-26b82618-52ea-4bf0-a1d7-d038d3bb8238 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:16.138451 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-26b82618-52ea-4bf0-a1d7-d038d3bb8238 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:16.141995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-26b82618-52ea-4bf0-a1d7-d038d3bb8238 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:16.142913 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-26b82618-52ea-4bf0-a1d7-d038d3bb8238 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:16.193384 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f7b6ffde-a143-481f-aa12-0b8539b76424 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:16.209878 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f7b6ffde-a143-481f-aa12-0b8539b76424 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 200 len: 1303 microversion: 2.1 time: 0.189702 May 26 16:56:16.210739 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 168/344] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:16 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 1303 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:16.527718 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-26b82618-52ea-4bf0-a1d7-d038d3bb8238 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:16.558817 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-26b82618-52ea-4bf0-a1d7-d038d3bb8238 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:16.569841 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-26b82618-52ea-4bf0-a1d7-d038d3bb8238 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:16.577236 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-26b82618-52ea-4bf0-a1d7-d038d3bb8238 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.480408 May 26 16:56:16.590510 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 177/345] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:16 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:16.946519 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-bc0f9376-1fde-47bd-8e18-4adc31789615 req-15f8ae33-df71-4845-b0c3-fe6996c91a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8efc5100-c116-4608-a1d9-26e418e0609e", "name": "network-vif-plugged", "status": "completed", "tag": "3477b3a3-f453-4aca-9e4e-a3d0795c1473"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:16.975822 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-bc0f9376-1fde-47bd-8e18-4adc31789615 req-15f8ae33-df71-4845-b0c3-fe6996c91a43 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:16.976980 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-bc0f9376-1fde-47bd-8e18-4adc31789615 req-15f8ae33-df71-4845-b0c3-fe6996c91a43 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:17.012829 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-bc0f9376-1fde-47bd-8e18-4adc31789615 req-15f8ae33-df71-4845-b0c3-fe6996c91a43 service nova] Creating event network-vif-plugged:3477b3a3-f453-4aca-9e4e-a3d0795c1473 for instance 8efc5100-c116-4608-a1d9-26e418e0609e on hv-cinder-83607 May 26 16:56:17.028003 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-bc0f9376-1fde-47bd-8e18-4adc31789615 req-15f8ae33-df71-4845-b0c3-fe6996c91a43 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088337 May 26 16:56:17.028355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-432a5838-b1cd-4109-b0df-7ac45c72f5d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:17.029384 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-432a5838-b1cd-4109-b0df-7ac45c72f5d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:17.034692 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 169/346] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:56:17.045046 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-432a5838-b1cd-4109-b0df-7ac45c72f5d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:17.045763 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-432a5838-b1cd-4109-b0df-7ac45c72f5d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:17.046939 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-432a5838-b1cd-4109-b0df-7ac45c72f5d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:17.047613 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-432a5838-b1cd-4109-b0df-7ac45c72f5d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:17.052249 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1284009a-a813-4d5f-a5f9-9662eca609d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:17.057392 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1284009a-a813-4d5f-a5f9-9662eca609d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:17.097626 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1284009a-a813-4d5f-a5f9-9662eca609d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:17.103041 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1284009a-a813-4d5f-a5f9-9662eca609d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:17.107781 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1284009a-a813-4d5f-a5f9-9662eca609d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:17.109875 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1284009a-a813-4d5f-a5f9-9662eca609d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:17.466728 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-432a5838-b1cd-4109-b0df-7ac45c72f5d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:17.476015 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-432a5838-b1cd-4109-b0df-7ac45c72f5d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.453873 May 26 16:56:17.476826 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 178/347] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:17 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:17.493637 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4bafe7c0-eba6-49e8-8f52-49aeb7bc9c10 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:17.493637 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4bafe7c0-eba6-49e8-8f52-49aeb7bc9c10 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 1a0e5df4-33a2-4d03-8f86-c68743d1dbba] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:17.508577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4bafe7c0-eba6-49e8-8f52-49aeb7bc9c10 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:17.509367 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4bafe7c0-eba6-49e8-8f52-49aeb7bc9c10 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:17.510394 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4bafe7c0-eba6-49e8-8f52-49aeb7bc9c10 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:17.511418 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4bafe7c0-eba6-49e8-8f52-49aeb7bc9c10 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:17.529311 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1284009a-a813-4d5f-a5f9-9662eca609d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:17.538767 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-4bafe7c0-eba6-49e8-8f52-49aeb7bc9c10 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] HTTP exception thrown: Instance 1a0e5df4-33a2-4d03-8f86-c68743d1dbba could not be found. May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4bafe7c0-eba6-49e8-8f52-49aeb7bc9c10 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Request method failure captured: May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba HTTP/1.1 May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7EHXqjriWK4_4HgX-_zh3rICs7Z4Y3Ihl-8SJgkvpkcBB2FF-OfCZYcsnpJyF68awNe9-v20uuMYj56GTE740UFiYmYUJsNKSPztJ0jKZ-McaUNvV-TEuuWyPOHd8XHe4kfjjl8QRPid0Orm5EDOQSxDUPQboXScbRkegVOVx0ERdA May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: dc9eb3074bcf4c8eb5ddec86dd21f676 May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-VolumesActionsTest-1329903296 May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:56:17.541867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:56:17.543777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc9eb3074bcf4c8eb5ddec86dd21f676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc9eb3074bcf4c8eb5ddec86dd21f676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc9eb3074bcf4c8eb5ddec86dd21f676", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc9eb3074bcf4c8eb5ddec86dd21f676"}]}] May 26 16:56:17.543777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-VolumesActionsTest-1329903296 May 26 16:56:17.543777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: dc9eb3074bcf4c8eb5ddec86dd21f676 May 26 16:56:17.543777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-VolumesActionsTest-1329903296 May 26 16:56:17.543777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-VolumesActionsTest-1329903296-project May 26 16:56:17.543777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:56:17.543777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:56:17.543777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 14b1aff9e40a44dbabe2766d3e51f914 May 26 16:56:17.543777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-VolumesActionsTest-1329903296-project May 26 16:56:17.543777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 16:56:17.543777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 1a0e5df4-33a2-4d03-8f86-c68743d1dbba could not be found. May 26 16:56:17.543777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '1a0e5df4-33a2-4d03-8f86-c68743d1dbba'} May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a0e5df4-33a2-4d03-8f86-c68743d1dbba could not be found. May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:56:17.544745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a0e5df4-33a2-4d03-8f86-c68743d1dbba could not be found. May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a0e5df4-33a2-4d03-8f86-c68743d1dbba could not be found. May 26 16:56:17.546871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:56:17.548160 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4bafe7c0-eba6-49e8-8f52-49aeb7bc9c10 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Returning 404 to user: Instance 1a0e5df4-33a2-4d03-8f86-c68743d1dbba could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:56:17.548160 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4bafe7c0-eba6-49e8-8f52-49aeb7bc9c10 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba" status: 404 len: 111 microversion: 2.1 time: 0.056589 May 26 16:56:17.548326 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1284009a-a813-4d5f-a5f9-9662eca609d7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1371 microversion: 2.1 time: 0.505831 May 26 16:56:17.559329 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 179/348] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:17 2022] GET /compute/v2.1/servers/1a0e5df4-33a2-4d03-8f86-c68743d1dbba => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:56:17.563319 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 170/349] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:17 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1371 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:17.612005 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1f39259d-543b-4f2d-aa4a-0e209f975c3d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:17.614011 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1f39259d-543b-4f2d-aa4a-0e209f975c3d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:17.635304 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1f39259d-543b-4f2d-aa4a-0e209f975c3d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:17.636674 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1f39259d-543b-4f2d-aa4a-0e209f975c3d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:17.638559 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1f39259d-543b-4f2d-aa4a-0e209f975c3d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:17.639572 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1f39259d-543b-4f2d-aa4a-0e209f975c3d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:17.671745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:17.751663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1453218707", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "networks": [{"uuid": "138add0c-7439-4779-a280-abe6357e82e9"}]}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:17.889480 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] validate_networks() for [('138add0c-7439-4779-a280-abe6357e82e9', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:56:17.986650 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1f39259d-543b-4f2d-aa4a-0e209f975c3d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:18.012800 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1f39259d-543b-4f2d-aa4a-0e209f975c3d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:18.015211 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1f39259d-543b-4f2d-aa4a-0e209f975c3d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:18.019279 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-1f39259d-543b-4f2d-aa4a-0e209f975c3d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1744 microversion: 2.20 time: 0.412085 May 26 16:56:18.019823 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 180/350] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:17 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1744 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:56:18.492401 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:56:18.493486 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:56:18.494164 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:56:18.494731 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:56:18.495340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:56:18.504629 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e40b1e0a-b0e5-4779-af7c-ee11df23812a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:18.506261 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e40b1e0a-b0e5-4779-af7c-ee11df23812a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:18.512193 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:18.512624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:18.513370 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:18.514472 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:18.515247 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:18.527607 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e40b1e0a-b0e5-4779-af7c-ee11df23812a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:18.529283 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e40b1e0a-b0e5-4779-af7c-ee11df23812a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:18.533212 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e40b1e0a-b0e5-4779-af7c-ee11df23812a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:18.544862 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Getting quotas for project dc9eb3074bcf4c8eb5ddec86dd21f676. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:56:18.549664 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e40b1e0a-b0e5-4779-af7c-ee11df23812a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:18.550295 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Getting quotas for user 14b1aff9e40a44dbabe2766d3e51f914 and project dc9eb3074bcf4c8eb5ddec86dd21f676. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:56:18.565933 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:56:18.568413 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:56:18.734435 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-96d86152-2f73-4542-bfd4-61b80c63580c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989826 May 26 16:56:18.746952 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 171/351] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 16:56:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 16:56:18.746952 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-59d99dea-3c21-4eb9-a5c6-167f3ad7a568 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:18.746952 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-59d99dea-3c21-4eb9-a5c6-167f3ad7a568 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:18.752559 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59d99dea-3c21-4eb9-a5c6-167f3ad7a568 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:18.753057 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59d99dea-3c21-4eb9-a5c6-167f3ad7a568 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:18.754258 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59d99dea-3c21-4eb9-a5c6-167f3ad7a568 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:18.755260 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59d99dea-3c21-4eb9-a5c6-167f3ad7a568 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:18.884943 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e40b1e0a-b0e5-4779-af7c-ee11df23812a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:18.914802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e40b1e0a-b0e5-4779-af7c-ee11df23812a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.418835 May 26 16:56:18.916127 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 181/352] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:18 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:18.939071 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-32a280d9-afc2-46ae-b897-564f6dc911da tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:18.940341 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-32a280d9-afc2-46ae-b897-564f6dc911da tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:19.165756 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-32a280d9-afc2-46ae-b897-564f6dc911da tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:19.186164 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-32a280d9-afc2-46ae-b897-564f6dc911da tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1214 microversion: 2.1 time: 0.267848 May 26 16:56:19.188273 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 182/353] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:18 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1214 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:19.211629 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5d1027c8-8d06-472a-b0a1-d65ed2f11f28 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:19.214604 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5d1027c8-8d06-472a-b0a1-d65ed2f11f28 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:19.231984 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-59d99dea-3c21-4eb9-a5c6-167f3ad7a568 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:19.235417 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d1027c8-8d06-472a-b0a1-d65ed2f11f28 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:19.236066 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d1027c8-8d06-472a-b0a1-d65ed2f11f28 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:19.238437 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d1027c8-8d06-472a-b0a1-d65ed2f11f28 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:19.241002 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d1027c8-8d06-472a-b0a1-d65ed2f11f28 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:19.254479 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-59d99dea-3c21-4eb9-a5c6-167f3ad7a568 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1371 microversion: 2.1 time: 0.516278 May 26 16:56:19.256412 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 172/354] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:18 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1371 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:19.547808 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5d1027c8-8d06-472a-b0a1-d65ed2f11f28 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:19.567700 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5d1027c8-8d06-472a-b0a1-d65ed2f11f28 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:19.570892 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5d1027c8-8d06-472a-b0a1-d65ed2f11f28 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:19.572131 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5d1027c8-8d06-472a-b0a1-d65ed2f11f28 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1744 microversion: 2.20 time: 0.382117 May 26 16:56:19.572700 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 183/355] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:19 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1744 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:19.937243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-97918935-addc-4a5b-8344-76337ffce38d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:19.938166 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-97918935-addc-4a5b-8344-76337ffce38d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:19.953837 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-97918935-addc-4a5b-8344-76337ffce38d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:19.956186 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-97918935-addc-4a5b-8344-76337ffce38d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:19.959941 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-97918935-addc-4a5b-8344-76337ffce38d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:19.964446 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-97918935-addc-4a5b-8344-76337ffce38d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:20.215628 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-97918935-addc-4a5b-8344-76337ffce38d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:20.221202 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-83413846-f135-4aa9-91e5-ce969883995f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:20.222791 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-83413846-f135-4aa9-91e5-ce969883995f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:20.237825 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-97918935-addc-4a5b-8344-76337ffce38d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.305854 May 26 16:56:20.239024 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 173/356] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:19 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:20.274538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-14f206c0-ef36-4d3a-a4db-7ca957235109 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:20.275173 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-14f206c0-ef36-4d3a-a4db-7ca957235109 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:20.290050 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-14f206c0-ef36-4d3a-a4db-7ca957235109 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:20.291017 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-14f206c0-ef36-4d3a-a4db-7ca957235109 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:20.292503 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-14f206c0-ef36-4d3a-a4db-7ca957235109 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:20.293340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-14f206c0-ef36-4d3a-a4db-7ca957235109 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:20.362721 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-83413846-f135-4aa9-91e5-ce969883995f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:20.374347 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-83413846-f135-4aa9-91e5-ce969883995f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1214 microversion: 2.1 time: 0.158296 May 26 16:56:20.376067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 184/357] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:20 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1214 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:20.550219 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-14f206c0-ef36-4d3a-a4db-7ca957235109 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:20.571761 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-14f206c0-ef36-4d3a-a4db-7ca957235109 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1566 microversion: 2.1 time: 0.301512 May 26 16:56:20.573088 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 174/358] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:20 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1566 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:56:20.601107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e7c266cd-2eb7-449f-825f-9acf7fb75031 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:20.604429 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-72e8ed8e-ea97-4dfe-97b2-881a84c2963a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:20.605175 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-72e8ed8e-ea97-4dfe-97b2-881a84c2963a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:20.609317 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e7c266cd-2eb7-449f-825f-9acf7fb75031 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:20.630049 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-72e8ed8e-ea97-4dfe-97b2-881a84c2963a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:20.632181 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-72e8ed8e-ea97-4dfe-97b2-881a84c2963a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:20.635767 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-72e8ed8e-ea97-4dfe-97b2-881a84c2963a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:20.636827 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-72e8ed8e-ea97-4dfe-97b2-881a84c2963a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:20.637614 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7c266cd-2eb7-449f-825f-9acf7fb75031 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:20.638391 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7c266cd-2eb7-449f-825f-9acf7fb75031 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:20.642052 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7c266cd-2eb7-449f-825f-9acf7fb75031 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:20.643126 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7c266cd-2eb7-449f-825f-9acf7fb75031 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:20.919498 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e7c266cd-2eb7-449f-825f-9acf7fb75031 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.327534 May 26 16:56:20.920781 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 175/359] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 26 16:56:20 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-interface => generated 285 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:56:20.936845 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-1bf5e2fd-692c-42a6-a291-1eee7ff27b58 req-69f4cfdf-785f-4c8f-9e51-0f4c101c5787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0daf7ae-8eab-479b-b4cb-380a68f5bfaa", "name": "network-vif-plugged", "status": "completed", "tag": "19f830e3-9d14-4893-a727-3c20d5993b34"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:20.952651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-1bf5e2fd-692c-42a6-a291-1eee7ff27b58 req-69f4cfdf-785f-4c8f-9e51-0f4c101c5787 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:20.954188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-1bf5e2fd-692c-42a6-a291-1eee7ff27b58 req-69f4cfdf-785f-4c8f-9e51-0f4c101c5787 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:20.982136 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-1bf5e2fd-692c-42a6-a291-1eee7ff27b58 req-69f4cfdf-785f-4c8f-9e51-0f4c101c5787 service nova] Creating event network-vif-plugged:19f830e3-9d14-4893-a727-3c20d5993b34 for instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa on hv-cinder-83607 May 26 16:56:20.994776 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-1bf5e2fd-692c-42a6-a291-1eee7ff27b58 req-69f4cfdf-785f-4c8f-9e51-0f4c101c5787 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061727 May 26 16:56:20.996138 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 176/360] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:56:21.128458 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-72e8ed8e-ea97-4dfe-97b2-881a84c2963a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:21.141319 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-72e8ed8e-ea97-4dfe-97b2-881a84c2963a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:21.147014 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-72e8ed8e-ea97-4dfe-97b2-881a84c2963a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:21.148747 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-72e8ed8e-ea97-4dfe-97b2-881a84c2963a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.561616 May 26 16:56:21.154041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 185/361] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:20 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:56:21.259757 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-72d26685-4b50-47de-a8cc-d9c3a9139ea2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:21.260976 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-72d26685-4b50-47de-a8cc-d9c3a9139ea2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:21.286940 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72d26685-4b50-47de-a8cc-d9c3a9139ea2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:21.288238 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72d26685-4b50-47de-a8cc-d9c3a9139ea2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:21.290116 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72d26685-4b50-47de-a8cc-d9c3a9139ea2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:21.290984 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72d26685-4b50-47de-a8cc-d9c3a9139ea2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:21.409531 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-770a4998-a4d9-4b73-be0a-c60a7a01d48b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:21.410483 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-770a4998-a4d9-4b73-be0a-c60a7a01d48b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:21.440494 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-770a4998-a4d9-4b73-be0a-c60a7a01d48b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:21.459562 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-770a4998-a4d9-4b73-be0a-c60a7a01d48b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:21.460807 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-770a4998-a4d9-4b73-be0a-c60a7a01d48b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:21.461510 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-770a4998-a4d9-4b73-be0a-c60a7a01d48b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:21.665092 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-770a4998-a4d9-4b73-be0a-c60a7a01d48b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:21.685147 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-770a4998-a4d9-4b73-be0a-c60a7a01d48b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1210 microversion: 2.1 time: 0.282039 May 26 16:56:21.689511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 186/362] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:21 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1210 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:21.734516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-72d26685-4b50-47de-a8cc-d9c3a9139ea2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:21.753137 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-72d26685-4b50-47de-a8cc-d9c3a9139ea2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.499950 May 26 16:56:21.771948 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 177/363] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:21 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:22.171481 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e5f0acd6-e2b1-43ff-b8c5-41b22270c629 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:22.172213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e5f0acd6-e2b1-43ff-b8c5-41b22270c629 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:22.184926 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5f0acd6-e2b1-43ff-b8c5-41b22270c629 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:22.185720 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5f0acd6-e2b1-43ff-b8c5-41b22270c629 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:22.187274 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5f0acd6-e2b1-43ff-b8c5-41b22270c629 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:22.190307 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5f0acd6-e2b1-43ff-b8c5-41b22270c629 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:22.715432 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-abb80916-786b-4aa8-8f50-f075b31bc789 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:22.716387 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-abb80916-786b-4aa8-8f50-f075b31bc789 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:22.724550 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:22.739501 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-abb80916-786b-4aa8-8f50-f075b31bc789 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:22.743403 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-abb80916-786b-4aa8-8f50-f075b31bc789 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:22.746509 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-abb80916-786b-4aa8-8f50-f075b31bc789 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:22.756683 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-abb80916-786b-4aa8-8f50-f075b31bc789 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:22.897650 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e5f0acd6-e2b1-43ff-b8c5-41b22270c629 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:22.925683 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e5f0acd6-e2b1-43ff-b8c5-41b22270c629 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:22.925683 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e5f0acd6-e2b1-43ff-b8c5-41b22270c629 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:22.939767 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e5f0acd6-e2b1-43ff-b8c5-41b22270c629 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.772107 May 26 16:56:22.940832 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 187/364] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:22 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:22.955847 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-19135be0-ff9f-4e0a-8230-b4f0600568c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:22.967812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-19135be0-ff9f-4e0a-8230-b4f0600568c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:22.987972 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-19135be0-ff9f-4e0a-8230-b4f0600568c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:22.988995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-19135be0-ff9f-4e0a-8230-b4f0600568c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:22.990850 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-19135be0-ff9f-4e0a-8230-b4f0600568c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:22.991900 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-19135be0-ff9f-4e0a-8230-b4f0600568c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:23.106563 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-abb80916-786b-4aa8-8f50-f075b31bc789 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:23.197644 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-abb80916-786b-4aa8-8f50-f075b31bc789 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1266 microversion: 2.1 time: 0.485780 May 26 16:56:23.218587 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 178/365] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:22 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1266 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:23.482576 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-19135be0-ff9f-4e0a-8230-b4f0600568c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:23.502918 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-19135be0-ff9f-4e0a-8230-b4f0600568c0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.560314 May 26 16:56:23.509012 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 188/366] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:22 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:23.970868 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-86b31c67-a554-41b4-a5bd-6a67c6c5aad3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:23.971609 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-86b31c67-a554-41b4-a5bd-6a67c6c5aad3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:24.005499 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86b31c67-a554-41b4-a5bd-6a67c6c5aad3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:24.012389 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86b31c67-a554-41b4-a5bd-6a67c6c5aad3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:24.022347 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86b31c67-a554-41b4-a5bd-6a67c6c5aad3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:24.024780 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86b31c67-a554-41b4-a5bd-6a67c6c5aad3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:24.238208 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-402a451e-070b-4877-89dd-1bbdc56123db tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:24.241158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-402a451e-070b-4877-89dd-1bbdc56123db tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:24.273785 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-402a451e-070b-4877-89dd-1bbdc56123db tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:24.275491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-402a451e-070b-4877-89dd-1bbdc56123db tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:24.279804 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-402a451e-070b-4877-89dd-1bbdc56123db tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:24.282061 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-402a451e-070b-4877-89dd-1bbdc56123db tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:24.645963 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-402a451e-070b-4877-89dd-1bbdc56123db tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:24.660269 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-402a451e-070b-4877-89dd-1bbdc56123db tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1284 microversion: 2.1 time: 0.432278 May 26 16:56:24.662872 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 189/367] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:24 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1284 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:56:24.678385 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8ed1ebc1-bf6b-4366-bd2c-702866bf1e15 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:24.679642 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8ed1ebc1-bf6b-4366-bd2c-702866bf1e15 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:24.693333 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ed1ebc1-bf6b-4366-bd2c-702866bf1e15 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:24.698107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ed1ebc1-bf6b-4366-bd2c-702866bf1e15 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:24.701136 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ed1ebc1-bf6b-4366-bd2c-702866bf1e15 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:24.701873 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ed1ebc1-bf6b-4366-bd2c-702866bf1e15 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:24.824114 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-86b31c67-a554-41b4-a5bd-6a67c6c5aad3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:24.826572 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:24.865313 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-86b31c67-a554-41b4-a5bd-6a67c6c5aad3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:24.876825 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-86b31c67-a554-41b4-a5bd-6a67c6c5aad3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:24.882280 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-86b31c67-a554-41b4-a5bd-6a67c6c5aad3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.918812 May 26 16:56:24.891299 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 179/368] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:23 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:24.941201 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-3de124b2-5aa5-4c4a-bf49-1506d7040271 req-8f04d0e6-eb2a-4c0d-9f5b-68d90f801940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8efc5100-c116-4608-a1d9-26e418e0609e", "tag": "3477b3a3-f453-4aca-9e4e-a3d0795c1473"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:25.009157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-3de124b2-5aa5-4c4a-bf49-1506d7040271 req-8f04d0e6-eb2a-4c0d-9f5b-68d90f801940 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:25.010942 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-3de124b2-5aa5-4c4a-bf49-1506d7040271 req-8f04d0e6-eb2a-4c0d-9f5b-68d90f801940 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:25.070543 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-3de124b2-5aa5-4c4a-bf49-1506d7040271 req-8f04d0e6-eb2a-4c0d-9f5b-68d90f801940 service nova] Creating event network-changed:3477b3a3-f453-4aca-9e4e-a3d0795c1473 for instance 8efc5100-c116-4608-a1d9-26e418e0609e on hv-cinder-83607 May 26 16:56:25.077930 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-3de124b2-5aa5-4c4a-bf49-1506d7040271 req-8f04d0e6-eb2a-4c0d-9f5b-68d90f801940 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181153 May 26 16:56:25.079681 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 180/369] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:56:25.100242 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8ed1ebc1-bf6b-4366-bd2c-702866bf1e15 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:25.113249 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8ed1ebc1-bf6b-4366-bd2c-702866bf1e15 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.445090 May 26 16:56:25.116440 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 190/370] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:24 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:25.506496 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b3724ea1-cd30-49dd-a855-afa552d1fefe tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Action: 'create', calling method: .version_select at 0x7fbe8057c670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-787864708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9tl8PVMQKwakmht9HVLylcZ7v6Ci8QelTF/GMbrXiAq5OK2Vi5eKhZ7yY/AdNg9NF2Il+teMhnlfbxh6P3Mq+coeuG2osq4MUfekKclbmVslxiNdH6IFwgdAoN3eLZqA=="}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:25.536216 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-b3724ea1-cd30-49dd-a855-afa552d1fefe tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Getting quotas for project 895a592d480548ddb6afdb1e7c45ed92. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:56:25.547601 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-b3724ea1-cd30-49dd-a855-afa552d1fefe tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Getting quotas for user 5d6ddab73db44710bcb5bba4c0cfbcfa and project 895a592d480548ddb6afdb1e7c45ed92. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:56:25.653662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b3724ea1-cd30-49dd-a855-afa552d1fefe tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.522763 May 26 16:56:25.655545 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 181/371] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 26 16:56:25 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:56:25.687578 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-51cebf91-4a1e-4a82-8513-84542b651f49 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:25.689846 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-51cebf91-4a1e-4a82-8513-84542b651f49 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:25.714975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-51cebf91-4a1e-4a82-8513-84542b651f49 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:25.717032 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-51cebf91-4a1e-4a82-8513-84542b651f49 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:25.720896 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-51cebf91-4a1e-4a82-8513-84542b651f49 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:25.722606 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-51cebf91-4a1e-4a82-8513-84542b651f49 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:25.896551 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-51cebf91-4a1e-4a82-8513-84542b651f49 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:25.908253 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-51cebf91-4a1e-4a82-8513-84542b651f49 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1272 microversion: 2.1 time: 0.227913 May 26 16:56:25.913642 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 191/372] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:25 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:25.959675 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e1203ea3-fbe1-4880-b0d8-7faa4b4afa85 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:25.964208 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e1203ea3-fbe1-4880-b0d8-7faa4b4afa85 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:25.982279 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1203ea3-fbe1-4880-b0d8-7faa4b4afa85 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:25.983671 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1203ea3-fbe1-4880-b0d8-7faa4b4afa85 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:25.986972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1203ea3-fbe1-4880-b0d8-7faa4b4afa85 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:25.987971 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1203ea3-fbe1-4880-b0d8-7faa4b4afa85 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:26.141602 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-cb6ec6c5-53a5-4797-8bad-7b7b47e72d13 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:26.146503 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-cb6ec6c5-53a5-4797-8bad-7b7b47e72d13 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:26.171788 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cb6ec6c5-53a5-4797-8bad-7b7b47e72d13 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:26.171788 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cb6ec6c5-53a5-4797-8bad-7b7b47e72d13 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:26.171788 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cb6ec6c5-53a5-4797-8bad-7b7b47e72d13 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:26.174853 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cb6ec6c5-53a5-4797-8bad-7b7b47e72d13 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:26.667154 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-cb6ec6c5-53a5-4797-8bad-7b7b47e72d13 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:26.704120 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e1203ea3-fbe1-4880-b0d8-7faa4b4afa85 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:26.713746 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-cb6ec6c5-53a5-4797-8bad-7b7b47e72d13 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.580565 May 26 16:56:26.722523 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 192/373] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:26 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:26.743096 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e1203ea3-fbe1-4880-b0d8-7faa4b4afa85 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:26.750838 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e1203ea3-fbe1-4880-b0d8-7faa4b4afa85 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:26.759272 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e1203ea3-fbe1-4880-b0d8-7faa4b4afa85 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.830722 May 26 16:56:26.766206 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 182/374] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:25 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:26.940672 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c4f96e6d-d648-4160-b3b5-8bee656daa5c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:26.941843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c4f96e6d-d648-4160-b3b5-8bee656daa5c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:26.967050 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c4f96e6d-d648-4160-b3b5-8bee656daa5c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:26.974299 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c4f96e6d-d648-4160-b3b5-8bee656daa5c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:26.981098 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c4f96e6d-d648-4160-b3b5-8bee656daa5c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:26.982340 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c4f96e6d-d648-4160-b3b5-8bee656daa5c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:27.420038 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c4f96e6d-d648-4160-b3b5-8bee656daa5c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:27.440025 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c4f96e6d-d648-4160-b3b5-8bee656daa5c tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1314 microversion: 2.1 time: 0.510561 May 26 16:56:27.453446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 193/375] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:26 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:27.743662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cd9ad789-ec7f-4094-a4dd-7b402a0cefae tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:27.744424 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cd9ad789-ec7f-4094-a4dd-7b402a0cefae tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:27.764132 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cd9ad789-ec7f-4094-a4dd-7b402a0cefae tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:27.764696 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cd9ad789-ec7f-4094-a4dd-7b402a0cefae tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:27.766663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cd9ad789-ec7f-4094-a4dd-7b402a0cefae tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:27.786757 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cd9ad789-ec7f-4094-a4dd-7b402a0cefae tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:27.789205 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-700be2ac-59c6-4ac4-9d29-727e93a44d35 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:27.790057 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-700be2ac-59c6-4ac4-9d29-727e93a44d35 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:27.805574 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-700be2ac-59c6-4ac4-9d29-727e93a44d35 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:27.809190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-700be2ac-59c6-4ac4-9d29-727e93a44d35 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:27.810331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-700be2ac-59c6-4ac4-9d29-727e93a44d35 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:27.816725 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-700be2ac-59c6-4ac4-9d29-727e93a44d35 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:28.400268 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cd9ad789-ec7f-4094-a4dd-7b402a0cefae tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:28.419762 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cd9ad789-ec7f-4094-a4dd-7b402a0cefae tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.683255 May 26 16:56:28.441224 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 183/376] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:27 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:28.460623 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-06d065d1-51e9-48fb-90ea-3506f98ac69e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:28.461643 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-06d065d1-51e9-48fb-90ea-3506f98ac69e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:28.470902 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-700be2ac-59c6-4ac4-9d29-727e93a44d35 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:28.489503 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-700be2ac-59c6-4ac4-9d29-727e93a44d35 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:28.489618 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-06d065d1-51e9-48fb-90ea-3506f98ac69e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:28.489618 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-06d065d1-51e9-48fb-90ea-3506f98ac69e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:28.491191 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-06d065d1-51e9-48fb-90ea-3506f98ac69e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:28.493161 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-06d065d1-51e9-48fb-90ea-3506f98ac69e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:28.493684 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-700be2ac-59c6-4ac4-9d29-727e93a44d35 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:28.497354 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-700be2ac-59c6-4ac4-9d29-727e93a44d35 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.712152 May 26 16:56:28.499217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 194/377] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:27 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:28.540524 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:28.867496 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-06d065d1-51e9-48fb-90ea-3506f98ac69e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:28.883674 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-06d065d1-51e9-48fb-90ea-3506f98ac69e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1314 microversion: 2.1 time: 0.427074 May 26 16:56:28.888209 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 184/378] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:28 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:56:29.439170 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c506a8c9-6c24-4c9c-9f28-ce5f28a3ae62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:29.440523 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c506a8c9-6c24-4c9c-9f28-ce5f28a3ae62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:29.454343 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-af01927f-f6e4-4c52-bce0-5c860ae29181 req-7db88498-619a-4cb6-b548-3e538929068a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88435a89-597c-4e0a-98f4-fd26adc22802", "tag": "f47da065-3037-45fd-81cc-1f01f1f60b8e"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:29.476642 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c506a8c9-6c24-4c9c-9f28-ce5f28a3ae62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:29.484069 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c506a8c9-6c24-4c9c-9f28-ce5f28a3ae62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:29.488875 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c506a8c9-6c24-4c9c-9f28-ce5f28a3ae62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:29.489384 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c506a8c9-6c24-4c9c-9f28-ce5f28a3ae62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:29.495183 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-af01927f-f6e4-4c52-bce0-5c860ae29181 req-7db88498-619a-4cb6-b548-3e538929068a service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:29.499046 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-af01927f-f6e4-4c52-bce0-5c860ae29181 req-7db88498-619a-4cb6-b548-3e538929068a service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:29.530168 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-af01927f-f6e4-4c52-bce0-5c860ae29181 req-7db88498-619a-4cb6-b548-3e538929068a service nova] Creating event network-changed:f47da065-3037-45fd-81cc-1f01f1f60b8e for instance 88435a89-597c-4e0a-98f4-fd26adc22802 on hv-cinder-83607 May 26 16:56:29.552017 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-af01927f-f6e4-4c52-bce0-5c860ae29181 req-7db88498-619a-4cb6-b548-3e538929068a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094488 May 26 16:56:29.554359 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 185/379] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:56:29.566248 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-62d6a4da-dd5e-4f69-b5cc-b8a1c8c99d01 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:29.571185 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-62d6a4da-dd5e-4f69-b5cc-b8a1c8c99d01 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:29.593961 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-62d6a4da-dd5e-4f69-b5cc-b8a1c8c99d01 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:29.594736 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-62d6a4da-dd5e-4f69-b5cc-b8a1c8c99d01 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:29.595797 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-62d6a4da-dd5e-4f69-b5cc-b8a1c8c99d01 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:29.599111 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-62d6a4da-dd5e-4f69-b5cc-b8a1c8c99d01 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:30.031088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c506a8c9-6c24-4c9c-9f28-ce5f28a3ae62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:30.042565 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-62d6a4da-dd5e-4f69-b5cc-b8a1c8c99d01 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:30.057906 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-62d6a4da-dd5e-4f69-b5cc-b8a1c8c99d01 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:30.059696 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-62d6a4da-dd5e-4f69-b5cc-b8a1c8c99d01 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:30.064231 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c506a8c9-6c24-4c9c-9f28-ce5f28a3ae62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.630768 May 26 16:56:30.068006 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-62d6a4da-dd5e-4f69-b5cc-b8a1c8c99d01 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.509517 May 26 16:56:30.072825 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 186/380] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:29 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:30.073417 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 195/381] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:29 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:56:30.079027 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-82ff570f-8d95-491b-a2ca-29578cce41b0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:30.079933 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-82ff570f-8d95-491b-a2ca-29578cce41b0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:30.089249 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-82ff570f-8d95-491b-a2ca-29578cce41b0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:30.096757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-82ff570f-8d95-491b-a2ca-29578cce41b0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:30.098280 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-82ff570f-8d95-491b-a2ca-29578cce41b0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:30.098903 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-82ff570f-8d95-491b-a2ca-29578cce41b0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:30.369167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=4 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:30.469434 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-82ff570f-8d95-491b-a2ca-29578cce41b0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:30.500786 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-82ff570f-8d95-491b-a2ca-29578cce41b0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1314 microversion: 2.1 time: 0.416562 May 26 16:56:30.500786 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 196/382] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:30 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:31.128270 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1f31413f-67bb-490b-954d-b26a0dde8d6f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:31.128270 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1f31413f-67bb-490b-954d-b26a0dde8d6f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:31.128270 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f31413f-67bb-490b-954d-b26a0dde8d6f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:31.128270 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f31413f-67bb-490b-954d-b26a0dde8d6f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:31.130242 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f31413f-67bb-490b-954d-b26a0dde8d6f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:31.130242 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f31413f-67bb-490b-954d-b26a0dde8d6f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:31.130599 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6f1928c7-aa04-4510-b88b-24b2e0032155 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:31.130599 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6f1928c7-aa04-4510-b88b-24b2e0032155 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:31.136465 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6f1928c7-aa04-4510-b88b-24b2e0032155 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:31.137540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6f1928c7-aa04-4510-b88b-24b2e0032155 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:31.138271 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6f1928c7-aa04-4510-b88b-24b2e0032155 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:31.138975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6f1928c7-aa04-4510-b88b-24b2e0032155 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:31.439473 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1f31413f-67bb-490b-954d-b26a0dde8d6f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:31.444154 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6f1928c7-aa04-4510-b88b-24b2e0032155 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:31.453147 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1f31413f-67bb-490b-954d-b26a0dde8d6f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.367757 May 26 16:56:31.454238 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 187/383] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:31 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:31.455848 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6f1928c7-aa04-4510-b88b-24b2e0032155 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:31.461317 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6f1928c7-aa04-4510-b88b-24b2e0032155 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:31.463516 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6f1928c7-aa04-4510-b88b-24b2e0032155 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.364085 May 26 16:56:31.464602 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 197/384] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:31 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:31.522758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5bb443c0-7209-4b02-84e7-060ed7031a6f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:31.524084 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5bb443c0-7209-4b02-84e7-060ed7031a6f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:31.534435 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5bb443c0-7209-4b02-84e7-060ed7031a6f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:31.535251 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5bb443c0-7209-4b02-84e7-060ed7031a6f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:31.536590 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5bb443c0-7209-4b02-84e7-060ed7031a6f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:31.537492 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5bb443c0-7209-4b02-84e7-060ed7031a6f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:31.709110 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5bb443c0-7209-4b02-84e7-060ed7031a6f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:31.724254 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5bb443c0-7209-4b02-84e7-060ed7031a6f tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1314 microversion: 2.1 time: 0.207075 May 26 16:56:31.735115 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 188/385] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:31 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:32.500411 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-23656655-5872-4ba3-bb64-51f15d7f4a07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:32.501506 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ac7056f8-f8ed-4d35-b848-581261a83521 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:32.506145 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ac7056f8-f8ed-4d35-b848-581261a83521 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:32.506390 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-23656655-5872-4ba3-bb64-51f15d7f4a07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:32.535760 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-23656655-5872-4ba3-bb64-51f15d7f4a07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:32.540811 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-23656655-5872-4ba3-bb64-51f15d7f4a07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:32.540811 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-23656655-5872-4ba3-bb64-51f15d7f4a07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:32.540811 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-23656655-5872-4ba3-bb64-51f15d7f4a07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:32.545773 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ac7056f8-f8ed-4d35-b848-581261a83521 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:32.546638 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ac7056f8-f8ed-4d35-b848-581261a83521 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:32.548060 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ac7056f8-f8ed-4d35-b848-581261a83521 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:32.548837 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ac7056f8-f8ed-4d35-b848-581261a83521 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:32.858576 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ac7056f8-f8ed-4d35-b848-581261a83521 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:32.873615 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ac7056f8-f8ed-4d35-b848-581261a83521 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1721 microversion: 2.1 time: 0.394000 May 26 16:56:32.875515 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 198/386] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:32 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1721 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:32.904935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-49c922b3-eaf4-4903-a62a-9f0b54b8c4af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:32.906032 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-49c922b3-eaf4-4903-a62a-9f0b54b8c4af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:32.924427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-49c922b3-eaf4-4903-a62a-9f0b54b8c4af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:32.924891 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-49c922b3-eaf4-4903-a62a-9f0b54b8c4af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:32.925714 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-49c922b3-eaf4-4903-a62a-9f0b54b8c4af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:32.926329 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-49c922b3-eaf4-4903-a62a-9f0b54b8c4af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:32.929568 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=100 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:32.949226 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-23656655-5872-4ba3-bb64-51f15d7f4a07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:32.961672 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-23656655-5872-4ba3-bb64-51f15d7f4a07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:32.964299 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-23656655-5872-4ba3-bb64-51f15d7f4a07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:32.966014 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-23656655-5872-4ba3-bb64-51f15d7f4a07 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.475160 May 26 16:56:32.978383 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 189/387] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:32 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:33.182595 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-49c922b3-eaf4-4903-a62a-9f0b54b8c4af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:33.197421 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-49c922b3-eaf4-4903-a62a-9f0b54b8c4af tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1314 microversion: 2.1 time: 0.319446 May 26 16:56:33.226088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 199/388] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:32 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:33.903486 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c0363cdb-c38a-4281-909b-b68973fcf9ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:33.905772 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c0363cdb-c38a-4281-909b-b68973fcf9ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:33.911957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0363cdb-c38a-4281-909b-b68973fcf9ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:33.913343 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0363cdb-c38a-4281-909b-b68973fcf9ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:33.914599 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0363cdb-c38a-4281-909b-b68973fcf9ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:33.915413 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0363cdb-c38a-4281-909b-b68973fcf9ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:33.992489 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-630f783c-eea0-486a-8747-c948fc9fe3a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:33.994771 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-630f783c-eea0-486a-8747-c948fc9fe3a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:34.009561 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-630f783c-eea0-486a-8747-c948fc9fe3a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:34.010299 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-630f783c-eea0-486a-8747-c948fc9fe3a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:34.014272 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-630f783c-eea0-486a-8747-c948fc9fe3a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:34.014984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-630f783c-eea0-486a-8747-c948fc9fe3a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:34.388830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c0363cdb-c38a-4281-909b-b68973fcf9ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:34.400439 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c0363cdb-c38a-4281-909b-b68973fcf9ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1698 microversion: 2.1 time: 0.508015 May 26 16:56:34.409506 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 190/389] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:33 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1698 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:34.414602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e7a0fab2-d461-428c-b1f7-75fc67fa9c2d tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:34.420274 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e7a0fab2-d461-428c-b1f7-75fc67fa9c2d tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:34.443888 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7a0fab2-d461-428c-b1f7-75fc67fa9c2d tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:34.444751 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7a0fab2-d461-428c-b1f7-75fc67fa9c2d tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:34.451688 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7a0fab2-d461-428c-b1f7-75fc67fa9c2d tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:34.452166 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7a0fab2-d461-428c-b1f7-75fc67fa9c2d tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:34.522354 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-630f783c-eea0-486a-8747-c948fc9fe3a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:34.533150 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-630f783c-eea0-486a-8747-c948fc9fe3a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:34.535172 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-630f783c-eea0-486a-8747-c948fc9fe3a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:34.536649 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-630f783c-eea0-486a-8747-c948fc9fe3a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.552317 May 26 16:56:34.549375 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 200/390] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:33 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:34.557103 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-08cca39e-44e7-4aff-a436-5903324f51f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:34.564817 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-08cca39e-44e7-4aff-a436-5903324f51f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:34.567810 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-08cca39e-44e7-4aff-a436-5903324f51f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:34.602063 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-08cca39e-44e7-4aff-a436-5903324f51f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Going to try to start instance {{(pid=124836) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 16:56:34.775871 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e7a0fab2-d461-428c-b1f7-75fc67fa9c2d tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:34.788869 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e7a0fab2-d461-428c-b1f7-75fc67fa9c2d tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1314 microversion: 2.1 time: 0.383748 May 26 16:56:34.789794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 191/391] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:34 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:34.858391 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-08cca39e-44e7-4aff-a436-5903324f51f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "POST /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/action" status: 202 len: 0 microversion: 2.1 time: 0.306730 May 26 16:56:34.864762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 201/392] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 26 16:56:34 2022] POST /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:56:34.876846 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f4358f71-8c45-434f-b4a5-197bcef65c39 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:34.877998 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f4358f71-8c45-434f-b4a5-197bcef65c39 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:34.893966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4358f71-8c45-434f-b4a5-197bcef65c39 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:34.898999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4358f71-8c45-434f-b4a5-197bcef65c39 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:34.898999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4358f71-8c45-434f-b4a5-197bcef65c39 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:34.898999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4358f71-8c45-434f-b4a5-197bcef65c39 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:35.215068 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f4358f71-8c45-434f-b4a5-197bcef65c39 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:35.234752 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f4358f71-8c45-434f-b4a5-197bcef65c39 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1707 microversion: 2.1 time: 0.367489 May 26 16:56:35.248343 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 192/393] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:34 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1707 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:56:35.556480 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2e424249-7379-4cbd-91f4-5cde359ff0fe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:35.557446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2e424249-7379-4cbd-91f4-5cde359ff0fe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:35.565386 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2e424249-7379-4cbd-91f4-5cde359ff0fe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:35.566116 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2e424249-7379-4cbd-91f4-5cde359ff0fe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:35.567098 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2e424249-7379-4cbd-91f4-5cde359ff0fe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:35.567711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2e424249-7379-4cbd-91f4-5cde359ff0fe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:35.810533 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b77ab51c-428a-46af-81f1-a52368a477f9 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:35.811761 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b77ab51c-428a-46af-81f1-a52368a477f9 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:35.815755 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=10 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:35.832484 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2e424249-7379-4cbd-91f4-5cde359ff0fe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:35.843044 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b77ab51c-428a-46af-81f1-a52368a477f9 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:35.844388 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b77ab51c-428a-46af-81f1-a52368a477f9 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:35.846060 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b77ab51c-428a-46af-81f1-a52368a477f9 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:35.847178 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b77ab51c-428a-46af-81f1-a52368a477f9 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:35.854218 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2e424249-7379-4cbd-91f4-5cde359ff0fe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:35.856683 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2e424249-7379-4cbd-91f4-5cde359ff0fe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:35.858238 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2e424249-7379-4cbd-91f4-5cde359ff0fe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.307095 May 26 16:56:35.859521 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 202/394] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:35 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:36.111695 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b77ab51c-428a-46af-81f1-a52368a477f9 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:36.122569 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b77ab51c-428a-46af-81f1-a52368a477f9 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1314 microversion: 2.1 time: 0.318901 May 26 16:56:36.123915 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 193/395] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:35 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:36.261005 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-57f757af-762a-4247-ac18-5aa83ded639a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:36.261005 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-57f757af-762a-4247-ac18-5aa83ded639a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:36.279025 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-57f757af-762a-4247-ac18-5aa83ded639a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:36.279025 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-57f757af-762a-4247-ac18-5aa83ded639a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:36.279025 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-57f757af-762a-4247-ac18-5aa83ded639a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:36.279025 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-57f757af-762a-4247-ac18-5aa83ded639a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:36.572639 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-17d4150c-445d-4b20-abbd-d0a0769dc16e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:36.573431 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-17d4150c-445d-4b20-abbd-d0a0769dc16e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:36.590837 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-17d4150c-445d-4b20-abbd-d0a0769dc16e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:36.591306 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-17d4150c-445d-4b20-abbd-d0a0769dc16e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:36.592117 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-17d4150c-445d-4b20-abbd-d0a0769dc16e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:36.592567 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-17d4150c-445d-4b20-abbd-d0a0769dc16e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:36.636489 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-17d4150c-445d-4b20-abbd-d0a0769dc16e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234/ips" status: 200 len: 151 microversion: 2.1 time: 0.068532 May 26 16:56:36.637441 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 194/396] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 26 16:56:36 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234/ips => generated 151 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:56:36.658026 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-57f757af-762a-4247-ac18-5aa83ded639a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:36.707995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-57f757af-762a-4247-ac18-5aa83ded639a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1707 microversion: 2.1 time: 0.452843 May 26 16:56:36.710321 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 203/397] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:36 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1707 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:56:36.892308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-105b5e7d-2493-47a6-add6-695306f9291f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:36.893195 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-105b5e7d-2493-47a6-add6-695306f9291f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:36.903895 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-105b5e7d-2493-47a6-add6-695306f9291f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:36.904663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-105b5e7d-2493-47a6-add6-695306f9291f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:36.906682 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-105b5e7d-2493-47a6-add6-695306f9291f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:36.910250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-105b5e7d-2493-47a6-add6-695306f9291f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:36.974259 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-d76398cb-8386-41fe-ab6a-782b56742ab2 req-a563736a-a014-4826-a068-67aba5efd1e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88435a89-597c-4e0a-98f4-fd26adc22802", "name": "network-vif-plugged", "status": "completed", "tag": "f47da065-3037-45fd-81cc-1f01f1f60b8e"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:36.994591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-d76398cb-8386-41fe-ab6a-782b56742ab2 req-a563736a-a014-4826-a068-67aba5efd1e0 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:36.996145 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-d76398cb-8386-41fe-ab6a-782b56742ab2 req-a563736a-a014-4826-a068-67aba5efd1e0 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:37.023180 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-d76398cb-8386-41fe-ab6a-782b56742ab2 req-a563736a-a014-4826-a068-67aba5efd1e0 service nova] Creating event network-vif-plugged:f47da065-3037-45fd-81cc-1f01f1f60b8e for instance 88435a89-597c-4e0a-98f4-fd26adc22802 on hv-cinder-83607 May 26 16:56:37.035528 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-d76398cb-8386-41fe-ab6a-782b56742ab2 req-a563736a-a014-4826-a068-67aba5efd1e0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068682 May 26 16:56:37.038169 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 204/398] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:56:37.157247 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-36e8634f-b664-4619-bea0-52c078e3dba6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:37.158930 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-36e8634f-b664-4619-bea0-52c078e3dba6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:37.174528 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-105b5e7d-2493-47a6-add6-695306f9291f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:37.188783 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-105b5e7d-2493-47a6-add6-695306f9291f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:37.189193 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-36e8634f-b664-4619-bea0-52c078e3dba6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:37.189900 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-36e8634f-b664-4619-bea0-52c078e3dba6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:37.191434 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-36e8634f-b664-4619-bea0-52c078e3dba6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:37.192060 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-36e8634f-b664-4619-bea0-52c078e3dba6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:37.194315 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-105b5e7d-2493-47a6-add6-695306f9291f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:37.196130 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-105b5e7d-2493-47a6-add6-695306f9291f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.313201 May 26 16:56:37.197287 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 195/399] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:36 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:37.449967 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-36e8634f-b664-4619-bea0-52c078e3dba6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:37.464615 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-36e8634f-b664-4619-bea0-52c078e3dba6 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1314 microversion: 2.1 time: 0.314937 May 26 16:56:37.486349 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 205/400] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:37 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:37.744177 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3e14374f-3ecc-4ce2-96cf-a2dbcc511f88 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:37.745188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3e14374f-3ecc-4ce2-96cf-a2dbcc511f88 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:37.768671 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e14374f-3ecc-4ce2-96cf-a2dbcc511f88 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:37.772505 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e14374f-3ecc-4ce2-96cf-a2dbcc511f88 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:37.774427 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e14374f-3ecc-4ce2-96cf-a2dbcc511f88 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:37.779567 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e14374f-3ecc-4ce2-96cf-a2dbcc511f88 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:38.029404 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3e14374f-3ecc-4ce2-96cf-a2dbcc511f88 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:38.045843 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3e14374f-3ecc-4ce2-96cf-a2dbcc511f88 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1707 microversion: 2.1 time: 0.307758 May 26 16:56:38.046890 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 196/401] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:37 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1707 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:38.215364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-21874640-1a76-46d9-ab4c-992d37f3c1fa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:38.216624 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-21874640-1a76-46d9-ab4c-992d37f3c1fa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:38.227233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-21874640-1a76-46d9-ab4c-992d37f3c1fa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:38.227694 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-21874640-1a76-46d9-ab4c-992d37f3c1fa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:38.228473 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-21874640-1a76-46d9-ab4c-992d37f3c1fa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:38.229129 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-21874640-1a76-46d9-ab4c-992d37f3c1fa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:38.482053 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5b7de0d1-4d15-450c-afac-4ff27d6905b5 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:38.482685 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5b7de0d1-4d15-450c-afac-4ff27d6905b5 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:38.497467 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5b7de0d1-4d15-450c-afac-4ff27d6905b5 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:38.498297 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5b7de0d1-4d15-450c-afac-4ff27d6905b5 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:38.499104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5b7de0d1-4d15-450c-afac-4ff27d6905b5 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:38.499545 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5b7de0d1-4d15-450c-afac-4ff27d6905b5 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:38.543828 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-21874640-1a76-46d9-ab4c-992d37f3c1fa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:38.559640 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-21874640-1a76-46d9-ab4c-992d37f3c1fa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:38.563006 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-21874640-1a76-46d9-ab4c-992d37f3c1fa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:38.565824 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-21874640-1a76-46d9-ab4c-992d37f3c1fa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.354368 May 26 16:56:38.567268 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 206/402] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:38 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:38.741631 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5b7de0d1-4d15-450c-afac-4ff27d6905b5 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:38.755280 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5b7de0d1-4d15-450c-afac-4ff27d6905b5 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1314 microversion: 2.1 time: 0.277028 May 26 16:56:38.756797 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 197/403] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:38 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:39.071706 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b20aba62-88b4-4481-b36d-2a7e33303773 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:39.072893 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b20aba62-88b4-4481-b36d-2a7e33303773 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:39.079974 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b20aba62-88b4-4481-b36d-2a7e33303773 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:39.080588 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b20aba62-88b4-4481-b36d-2a7e33303773 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:39.081507 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b20aba62-88b4-4481-b36d-2a7e33303773 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:39.082192 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b20aba62-88b4-4481-b36d-2a7e33303773 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:39.307650 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b20aba62-88b4-4481-b36d-2a7e33303773 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:39.317948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b20aba62-88b4-4481-b36d-2a7e33303773 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1707 microversion: 2.1 time: 0.255686 May 26 16:56:39.321304 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 207/404] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:39 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1707 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:39.603540 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1afe3554-4135-433f-aff4-8fa1469ca3aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:39.604701 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1afe3554-4135-433f-aff4-8fa1469ca3aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:39.613754 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1afe3554-4135-433f-aff4-8fa1469ca3aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:39.616361 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1afe3554-4135-433f-aff4-8fa1469ca3aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:39.617986 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1afe3554-4135-433f-aff4-8fa1469ca3aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:39.619128 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1afe3554-4135-433f-aff4-8fa1469ca3aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:39.783446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a3e9166c-6b0c-4319-bd67-4edf81143f18 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:39.783446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a3e9166c-6b0c-4319-bd67-4edf81143f18 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:39.789003 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a3e9166c-6b0c-4319-bd67-4edf81143f18 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:39.789595 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a3e9166c-6b0c-4319-bd67-4edf81143f18 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:39.790568 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a3e9166c-6b0c-4319-bd67-4edf81143f18 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:39.791081 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a3e9166c-6b0c-4319-bd67-4edf81143f18 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:39.923394 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1afe3554-4135-433f-aff4-8fa1469ca3aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:39.933023 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1afe3554-4135-433f-aff4-8fa1469ca3aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:39.934993 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1afe3554-4135-433f-aff4-8fa1469ca3aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:39.936458 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1afe3554-4135-433f-aff4-8fa1469ca3aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.339689 May 26 16:56:39.948724 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 198/405] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:39 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:40.055462 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a3e9166c-6b0c-4319-bd67-4edf81143f18 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:40.066123 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a3e9166c-6b0c-4319-bd67-4edf81143f18 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1314 microversion: 2.1 time: 0.290513 May 26 16:56:40.066847 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 208/406] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:39 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:40.345372 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-df264657-a124-493e-88ba-1b404dd3b87d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:40.346181 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-df264657-a124-493e-88ba-1b404dd3b87d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:40.355302 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df264657-a124-493e-88ba-1b404dd3b87d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:40.355754 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df264657-a124-493e-88ba-1b404dd3b87d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:40.356544 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df264657-a124-493e-88ba-1b404dd3b87d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:40.357012 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df264657-a124-493e-88ba-1b404dd3b87d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:40.359987 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:40.548420 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-df264657-a124-493e-88ba-1b404dd3b87d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:40.558929 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-df264657-a124-493e-88ba-1b404dd3b87d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1707 microversion: 2.1 time: 0.218956 May 26 16:56:40.559518 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 199/407] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:40 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1707 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:40.957289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-acc777e5-6de2-44db-84fa-e4e81cd7c492 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:40.958146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-acc777e5-6de2-44db-84fa-e4e81cd7c492 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:40.996687 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-acc777e5-6de2-44db-84fa-e4e81cd7c492 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:40.998630 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-acc777e5-6de2-44db-84fa-e4e81cd7c492 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:41.001475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-acc777e5-6de2-44db-84fa-e4e81cd7c492 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:41.003779 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-acc777e5-6de2-44db-84fa-e4e81cd7c492 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:41.020308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7d04aef9-0905-4890-a69a-94f7ab02b930 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c16c3971-32b8-4acb-9946-b4202c4adc6d"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:41.022850 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7d04aef9-0905-4890-a69a-94f7ab02b930 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:41.040365 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d04aef9-0905-4890-a69a-94f7ab02b930 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:41.041226 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d04aef9-0905-4890-a69a-94f7ab02b930 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:41.042326 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d04aef9-0905-4890-a69a-94f7ab02b930 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:41.043128 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d04aef9-0905-4890-a69a-94f7ab02b930 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:41.305512 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-acc777e5-6de2-44db-84fa-e4e81cd7c492 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:41.322360 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-acc777e5-6de2-44db-84fa-e4e81cd7c492 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:41.326519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-acc777e5-6de2-44db-84fa-e4e81cd7c492 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:41.329167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-acc777e5-6de2-44db-84fa-e4e81cd7c492 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.375907 May 26 16:56:41.330485 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 209/408] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:40 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:41.341229 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-cd007977-41f1-4353-8844-a880d885e221 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:41.342945 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-cd007977-41f1-4353-8844-a880d885e221 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:41.365990 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cd007977-41f1-4353-8844-a880d885e221 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:41.371098 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cd007977-41f1-4353-8844-a880d885e221 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:41.373714 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cd007977-41f1-4353-8844-a880d885e221 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:41.375627 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cd007977-41f1-4353-8844-a880d885e221 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:41.630107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-cd007977-41f1-4353-8844-a880d885e221 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:41.646647 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-cd007977-41f1-4353-8844-a880d885e221 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1314 microversion: 2.1 time: 0.313869 May 26 16:56:41.647458 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 210/409] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:41 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:41.656919 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-52db3740-14fa-4962-a301-7ab3d51e37b1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:41.658155 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-52db3740-14fa-4962-a301-7ab3d51e37b1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:41.668620 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-52db3740-14fa-4962-a301-7ab3d51e37b1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:41.669366 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-52db3740-14fa-4962-a301-7ab3d51e37b1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:41.670327 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-52db3740-14fa-4962-a301-7ab3d51e37b1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:41.670914 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-52db3740-14fa-4962-a301-7ab3d51e37b1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:41.881220 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-52db3740-14fa-4962-a301-7ab3d51e37b1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:41.897916 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-52db3740-14fa-4962-a301-7ab3d51e37b1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1711 microversion: 2.1 time: 0.248322 May 26 16:56:41.898793 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 211/410] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:41 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1711 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:42.353865 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-eaf701a7-db3f-4fb3-84ca-e84ad2a0ccde tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:42.355020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-eaf701a7-db3f-4fb3-84ca-e84ad2a0ccde tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:42.364456 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eaf701a7-db3f-4fb3-84ca-e84ad2a0ccde tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:42.364899 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eaf701a7-db3f-4fb3-84ca-e84ad2a0ccde tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:42.365764 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eaf701a7-db3f-4fb3-84ca-e84ad2a0ccde tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:42.366170 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eaf701a7-db3f-4fb3-84ca-e84ad2a0ccde tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:42.536608 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-eaf701a7-db3f-4fb3-84ca-e84ad2a0ccde tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:42.546392 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-eaf701a7-db3f-4fb3-84ca-e84ad2a0ccde tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:42.547957 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-eaf701a7-db3f-4fb3-84ca-e84ad2a0ccde tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:42.549167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-eaf701a7-db3f-4fb3-84ca-e84ad2a0ccde tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.203923 May 26 16:56:42.549777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 212/411] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:42 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:42.673692 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f6f3a344-6c39-4c1d-82e8-117506749bc4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:42.674300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f6f3a344-6c39-4c1d-82e8-117506749bc4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:42.680760 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f6f3a344-6c39-4c1d-82e8-117506749bc4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:42.681215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f6f3a344-6c39-4c1d-82e8-117506749bc4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:42.682005 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f6f3a344-6c39-4c1d-82e8-117506749bc4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:42.682450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f6f3a344-6c39-4c1d-82e8-117506749bc4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:42.859125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f6f3a344-6c39-4c1d-82e8-117506749bc4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:42.877661 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f6f3a344-6c39-4c1d-82e8-117506749bc4 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1314 microversion: 2.1 time: 0.201488 May 26 16:56:42.877661 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 213/412] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:42 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:56:43.204426 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7d04aef9-0905-4890-a69a-94f7ab02b930 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "POST /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.188496 May 26 16:56:43.205586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 200/413] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 26 16:56:41 2022] POST /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234/os-volume_attachments => generated 194 bytes in 2191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:56:43.571873 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2f7dda5f-9a8f-4344-a6db-aae574739723 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:43.819428 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2f7dda5f-9a8f-4344-a6db-aae574739723 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:43.819428 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2f7dda5f-9a8f-4344-a6db-aae574739723 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:43.819428 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2f7dda5f-9a8f-4344-a6db-aae574739723 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:43.819428 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2f7dda5f-9a8f-4344-a6db-aae574739723 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:43.822995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2f7dda5f-9a8f-4344-a6db-aae574739723 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:43.822995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2f7dda5f-9a8f-4344-a6db-aae574739723 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:43.824816 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2f7dda5f-9a8f-4344-a6db-aae574739723 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:43.824816 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2f7dda5f-9a8f-4344-a6db-aae574739723 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:43.824816 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2f7dda5f-9a8f-4344-a6db-aae574739723 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1739 microversion: 2.20 time: 0.240127 May 26 16:56:43.826558 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 214/414] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:43 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:43.927923 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-41cc45de-fcdf-4c4f-948d-bcceb51d1a1b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:43.927923 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-41cc45de-fcdf-4c4f-948d-bcceb51d1a1b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:43.927923 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-41cc45de-fcdf-4c4f-948d-bcceb51d1a1b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:43.927923 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-41cc45de-fcdf-4c4f-948d-bcceb51d1a1b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:43.928696 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-41cc45de-fcdf-4c4f-948d-bcceb51d1a1b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:43.928696 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-41cc45de-fcdf-4c4f-948d-bcceb51d1a1b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:44.068728 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-41cc45de-fcdf-4c4f-948d-bcceb51d1a1b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:44.081062 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-41cc45de-fcdf-4c4f-948d-bcceb51d1a1b tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1497 microversion: 2.1 time: 0.188627 May 26 16:56:44.081697 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 201/415] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:43 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:44.836441 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4aeccdb4-9a67-4d8f-b35c-95e31459836e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:44.838652 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4aeccdb4-9a67-4d8f-b35c-95e31459836e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:44.848043 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4aeccdb4-9a67-4d8f-b35c-95e31459836e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:44.848536 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4aeccdb4-9a67-4d8f-b35c-95e31459836e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:44.849962 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4aeccdb4-9a67-4d8f-b35c-95e31459836e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:44.851089 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4aeccdb4-9a67-4d8f-b35c-95e31459836e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:44.899703 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:45.083085 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4aeccdb4-9a67-4d8f-b35c-95e31459836e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:45.089865 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4aeccdb4-9a67-4d8f-b35c-95e31459836e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:45.091315 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4aeccdb4-9a67-4d8f-b35c-95e31459836e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:45.092498 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4aeccdb4-9a67-4d8f-b35c-95e31459836e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1721 microversion: 2.20 time: 0.262499 May 26 16:56:45.093072 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 215/416] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:44 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:45.444643 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-16dafdb6-9b78-41ca-bd19-ac03762670ea tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:45.445624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-16dafdb6-9b78-41ca-bd19-ac03762670ea tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:45.458325 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-16dafdb6-9b78-41ca-bd19-ac03762670ea tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:45.459177 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-16dafdb6-9b78-41ca-bd19-ac03762670ea tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:45.460632 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-16dafdb6-9b78-41ca-bd19-ac03762670ea tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:45.461494 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-16dafdb6-9b78-41ca-bd19-ac03762670ea tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:45.513542 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-16dafdb6-9b78-41ca-bd19-ac03762670ea tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:56:45.861824 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-16dafdb6-9b78-41ca-bd19-ac03762670ea tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "DELETE /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 204 len: 0 microversion: 2.1 time: 0.425238 May 26 16:56:45.862741 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 202/417] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 16:56:45 2022] DELETE /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:56:45.872120 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3c9a071d-4198-4c5a-b42f-856b52c4297e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:45.875190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3c9a071d-4198-4c5a-b42f-856b52c4297e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:45.886700 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3c9a071d-4198-4c5a-b42f-856b52c4297e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:45.887592 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3c9a071d-4198-4c5a-b42f-856b52c4297e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:45.888973 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3c9a071d-4198-4c5a-b42f-856b52c4297e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:45.889993 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3c9a071d-4198-4c5a-b42f-856b52c4297e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:46.060262 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3c9a071d-4198-4c5a-b42f-856b52c4297e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:46.070112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3c9a071d-4198-4c5a-b42f-856b52c4297e tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1503 microversion: 2.1 time: 0.202435 May 26 16:56:46.071049 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 216/418] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:45 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1503 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:46.113490 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8e61bfc3-41dc-4408-b224-c778aa689874 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:46.114196 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8e61bfc3-41dc-4408-b224-c778aa689874 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:46.121362 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e61bfc3-41dc-4408-b224-c778aa689874 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:46.121811 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e61bfc3-41dc-4408-b224-c778aa689874 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:46.122581 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e61bfc3-41dc-4408-b224-c778aa689874 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:46.123024 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8e61bfc3-41dc-4408-b224-c778aa689874 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:46.270908 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8e61bfc3-41dc-4408-b224-c778aa689874 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:46.280710 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8e61bfc3-41dc-4408-b224-c778aa689874 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:46.282339 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8e61bfc3-41dc-4408-b224-c778aa689874 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:46.283552 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8e61bfc3-41dc-4408-b224-c778aa689874 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1721 microversion: 2.20 time: 0.174645 May 26 16:56:46.284125 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 203/419] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:46 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:46.957660 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-a1813c4c-f699-4f42-8fa6-f9790e016007 req-709322d6-69cb-4f8b-9c63-7d358bb96f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0daf7ae-8eab-479b-b4cb-380a68f5bfaa", "name": "network-vif-unplugged", "status": "completed", "tag": "19f830e3-9d14-4893-a727-3c20d5993b34"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:46.967861 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-a1813c4c-f699-4f42-8fa6-f9790e016007 req-709322d6-69cb-4f8b-9c63-7d358bb96f0e service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:46.968307 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-a1813c4c-f699-4f42-8fa6-f9790e016007 req-709322d6-69cb-4f8b-9c63-7d358bb96f0e service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:46.984246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-a1813c4c-f699-4f42-8fa6-f9790e016007 req-709322d6-69cb-4f8b-9c63-7d358bb96f0e service nova] Creating event network-vif-unplugged:19f830e3-9d14-4893-a727-3c20d5993b34 for instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa on hv-cinder-83607 May 26 16:56:46.991001 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-a1813c4c-f699-4f42-8fa6-f9790e016007 req-709322d6-69cb-4f8b-9c63-7d358bb96f0e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037107 May 26 16:56:46.991991 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 217/420] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:56:47.090857 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-36590f28-024b-4283-ba29-98fe37a35ca0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:47.091762 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-36590f28-024b-4283-ba29-98fe37a35ca0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:47.101514 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-36590f28-024b-4283-ba29-98fe37a35ca0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:47.102092 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-36590f28-024b-4283-ba29-98fe37a35ca0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:47.103157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-36590f28-024b-4283-ba29-98fe37a35ca0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:47.103680 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-36590f28-024b-4283-ba29-98fe37a35ca0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:47.270683 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-36590f28-024b-4283-ba29-98fe37a35ca0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:47.280002 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-36590f28-024b-4283-ba29-98fe37a35ca0 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1503 microversion: 2.1 time: 0.194533 May 26 16:56:47.281134 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 204/421] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:47 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:47.306647 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-15497a0e-6b26-4de7-b622-ff9f99f6ac0f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:47.307357 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-15497a0e-6b26-4de7-b622-ff9f99f6ac0f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:47.316432 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-15497a0e-6b26-4de7-b622-ff9f99f6ac0f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:47.317097 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-15497a0e-6b26-4de7-b622-ff9f99f6ac0f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:47.319044 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-15497a0e-6b26-4de7-b622-ff9f99f6ac0f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:47.319555 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-15497a0e-6b26-4de7-b622-ff9f99f6ac0f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:47.482623 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-15497a0e-6b26-4de7-b622-ff9f99f6ac0f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:47.495118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-15497a0e-6b26-4de7-b622-ff9f99f6ac0f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:47.496676 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-15497a0e-6b26-4de7-b622-ff9f99f6ac0f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:47.498083 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-15497a0e-6b26-4de7-b622-ff9f99f6ac0f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1721 microversion: 2.20 time: 0.197337 May 26 16:56:47.498651 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 218/422] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:47 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:48.300473 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b53cede9-8471-495b-b6fd-5807ceefce0a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:48.301344 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b53cede9-8471-495b-b6fd-5807ceefce0a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:48.314930 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b53cede9-8471-495b-b6fd-5807ceefce0a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:48.315175 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b53cede9-8471-495b-b6fd-5807ceefce0a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:48.316147 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b53cede9-8471-495b-b6fd-5807ceefce0a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:48.316805 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b53cede9-8471-495b-b6fd-5807ceefce0a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:48.465507 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b53cede9-8471-495b-b6fd-5807ceefce0a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:48.473522 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b53cede9-8471-495b-b6fd-5807ceefce0a tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1503 microversion: 2.1 time: 0.177510 May 26 16:56:48.474101 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 205/423] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:48 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:56:48.520489 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-fc9cd94c-28cb-4487-95a5-131e92b68f37 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:48.521012 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-fc9cd94c-28cb-4487-95a5-131e92b68f37 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:48.530416 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fc9cd94c-28cb-4487-95a5-131e92b68f37 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:48.530874 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fc9cd94c-28cb-4487-95a5-131e92b68f37 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:48.531657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fc9cd94c-28cb-4487-95a5-131e92b68f37 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:48.532133 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fc9cd94c-28cb-4487-95a5-131e92b68f37 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:48.679042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-fc9cd94c-28cb-4487-95a5-131e92b68f37 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:48.685650 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-fc9cd94c-28cb-4487-95a5-131e92b68f37 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:48.687153 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-fc9cd94c-28cb-4487-95a5-131e92b68f37 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:48.688359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-fc9cd94c-28cb-4487-95a5-131e92b68f37 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1721 microversion: 2.20 time: 0.173824 May 26 16:56:48.689175 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 219/424] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:48 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:49.498253 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5a525325-41db-4ac7-aec5-441acb844f04 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:49.499451 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5a525325-41db-4ac7-aec5-441acb844f04 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:49.511970 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5a525325-41db-4ac7-aec5-441acb844f04 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:49.513515 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5a525325-41db-4ac7-aec5-441acb844f04 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:49.514063 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5a525325-41db-4ac7-aec5-441acb844f04 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:49.515126 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5a525325-41db-4ac7-aec5-441acb844f04 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:49.699217 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5a525325-41db-4ac7-aec5-441acb844f04 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:49.707313 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2472194b-d057-4954-a8c3-4906c7538f6d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:49.709099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5a525325-41db-4ac7-aec5-441acb844f04 tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1503 microversion: 2.1 time: 0.218549 May 26 16:56:49.709238 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2472194b-d057-4954-a8c3-4906c7538f6d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:49.709576 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 206/425] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:49 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:49.710596 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=82 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:49.718773 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2472194b-d057-4954-a8c3-4906c7538f6d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:49.719230 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2472194b-d057-4954-a8c3-4906c7538f6d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:49.720021 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2472194b-d057-4954-a8c3-4906c7538f6d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:49.720484 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2472194b-d057-4954-a8c3-4906c7538f6d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:49.863915 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2472194b-d057-4954-a8c3-4906c7538f6d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:49.872941 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2472194b-d057-4954-a8c3-4906c7538f6d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:49.874976 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2472194b-d057-4954-a8c3-4906c7538f6d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:49.876236 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2472194b-d057-4954-a8c3-4906c7538f6d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1724 microversion: 2.20 time: 0.172833 May 26 16:56:49.876809 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 220/426] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:49 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:56:49.898360 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f401433a-9c8b-4066-a630-4bd2f28bac6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0492a8e-40a9-4235-89ec-dc5699dd71d2"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:49.899498 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f401433a-9c8b-4066-a630-4bd2f28bac6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:49.919986 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f401433a-9c8b-4066-a630-4bd2f28bac6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:49.920453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f401433a-9c8b-4066-a630-4bd2f28bac6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:49.921285 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f401433a-9c8b-4066-a630-4bd2f28bac6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:49.921793 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f401433a-9c8b-4066-a630-4bd2f28bac6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:50.492949 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ebea4caa-6213-488a-b610-f893c3b67ea6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Action: 'create', calling method: .version_select at 0x7fbe804ef8b0>, body: {"keypair": {"name": "tempest-keypair-906685521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJweeXbmfLmvsQqKhbdYZN3VK3h0jOcblv+KvsKKyWOzOTsmZUMwPORzrnW6irhMJAZBSe6JRxZoPl40jed0trOR6COxL75aw0/on1RkVCYkC0rzoydJeOwK9AaoLgMgA=="}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:50.510287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-ebea4caa-6213-488a-b610-f893c3b67ea6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'key_pairs'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:56:50.513933 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-ebea4caa-6213-488a-b610-f893c3b67ea6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for user 1551f28754a64d1d9010ed90b67c5dc4 and project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'key_pairs'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:56:50.645573 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ebea4caa-6213-488a-b610-f893c3b67ea6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.158248 May 26 16:56:50.646171 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 221/427] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 26 16:56:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:56:50.650817 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-09325d57-71fe-4967-b4f0-b2869a61b6f7 req-a933af9d-db80-4004-947e-66613bd538c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88435a89-597c-4e0a-98f4-fd26adc22802", "name": "network-vif-deleted", "tag": "f47da065-3037-45fd-81cc-1f01f1f60b8e"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:50.659263 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-09325d57-71fe-4967-b4f0-b2869a61b6f7 req-a933af9d-db80-4004-947e-66613bd538c0 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:50.659913 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-09325d57-71fe-4967-b4f0-b2869a61b6f7 req-a933af9d-db80-4004-947e-66613bd538c0 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:50.675687 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-09325d57-71fe-4967-b4f0-b2869a61b6f7 req-a933af9d-db80-4004-947e-66613bd538c0 service nova] Creating event network-vif-deleted:f47da065-3037-45fd-81cc-1f01f1f60b8e for instance 88435a89-597c-4e0a-98f4-fd26adc22802 on hv-cinder-83607 May 26 16:56:50.677017 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-09325d57-71fe-4967-b4f0-b2869a61b6f7 req-a933af9d-db80-4004-947e-66613bd538c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029702 May 26 16:56:50.678646 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 222/428] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:56:50.729417 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-df3ad31e-fb15-48d9-9b88-fed0b50138fb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:50.730156 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-df3ad31e-fb15-48d9-9b88-fed0b50138fb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:50.736801 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-df3ad31e-fb15-48d9-9b88-fed0b50138fb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:50.746634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-df3ad31e-fb15-48d9-9b88-fed0b50138fb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:50.746634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-df3ad31e-fb15-48d9-9b88-fed0b50138fb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:50.746634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-df3ad31e-fb15-48d9-9b88-fed0b50138fb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:50.828229 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-df3ad31e-fb15-48d9-9b88-fed0b50138fb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b1aff9e40a44dbabe2766d3e51f914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc9eb3074bcf4c8eb5ddec86dd21f676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:50.847637 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-df3ad31e-fb15-48d9-9b88-fed0b50138fb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 200 len: 1461 microversion: 2.1 time: 0.122546 May 26 16:56:50.848223 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 223/429] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:50 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 1461 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:56:51.062333 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f401433a-9c8b-4066-a630-4bd2f28bac6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "POST /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.168646 May 26 16:56:51.070767 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 207/430] 10.222.0.48 () {62 vars in 1363 bytes} [Thu May 26 16:56:49 2022] POST /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/os-volume_attachments => generated 188 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:56:51.208200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e9a1caf6-3a31-445d-aac1-bc47c96fed10 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:51.209508 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e9a1caf6-3a31-445d-aac1-bc47c96fed10 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:51.216982 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e9a1caf6-3a31-445d-aac1-bc47c96fed10 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:51.223456 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e9a1caf6-3a31-445d-aac1-bc47c96fed10 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:51.223456 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e9a1caf6-3a31-445d-aac1-bc47c96fed10 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:51.223456 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e9a1caf6-3a31-445d-aac1-bc47c96fed10 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:51.523817 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e9a1caf6-3a31-445d-aac1-bc47c96fed10 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "POST /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/action" status: 202 len: 0 microversion: 2.20 time: 0.319669 May 26 16:56:51.524585 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 224/431] 10.222.0.48 () {62 vars in 1318 bytes} [Thu May 26 16:56:51 2022] POST /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 16:56:51.533070 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bf22305b-589c-49b3-9f18-d866f6d9b3df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:51.533920 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bf22305b-589c-49b3-9f18-d866f6d9b3df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:51.543974 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf22305b-589c-49b3-9f18-d866f6d9b3df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:51.544523 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf22305b-589c-49b3-9f18-d866f6d9b3df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:51.548669 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf22305b-589c-49b3-9f18-d866f6d9b3df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:51.548669 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf22305b-589c-49b3-9f18-d866f6d9b3df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:51.790483 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bf22305b-589c-49b3-9f18-d866f6d9b3df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:51.801875 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bf22305b-589c-49b3-9f18-d866f6d9b3df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:51.807755 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bf22305b-589c-49b3-9f18-d866f6d9b3df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:51.807755 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bf22305b-589c-49b3-9f18-d866f6d9b3df tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1750 microversion: 2.20 time: 0.276507 May 26 16:56:51.807755 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 208/432] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:51 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1750 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:56:51.882388 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ed865f29-cb21-4f87-a3ac-c1d0f081e6eb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:51.882388 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ed865f29-cb21-4f87-a3ac-c1d0f081e6eb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] [instance: 88435a89-597c-4e0a-98f4-fd26adc22802] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:51.887555 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ed865f29-cb21-4f87-a3ac-c1d0f081e6eb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:51.888134 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ed865f29-cb21-4f87-a3ac-c1d0f081e6eb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:51.889497 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ed865f29-cb21-4f87-a3ac-c1d0f081e6eb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:51.890022 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ed865f29-cb21-4f87-a3ac-c1d0f081e6eb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:51.911305 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-ed865f29-cb21-4f87-a3ac-c1d0f081e6eb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] HTTP exception thrown: Instance 88435a89-597c-4e0a-98f4-fd26adc22802 could not be found. May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ed865f29-cb21-4f87-a3ac-c1d0f081e6eb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Request method failure captured: May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 HTTP/1.1 May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7EHXqjriWK4_4HgX-_zh3rICs7Z4Y3Ihl-8SJgkvpkcBB2FF-OfCZYcsnpJyF68awNe9-v20uuMYj56GTE740UFiYmYUJsNKSPztJ0jKZ-McaUNvV-TEuuWyPOHd8XHe4kfjjl8QRPid0Orm5EDOQSxDUPQboXScbRkegVOVx0ERdA May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: dc9eb3074bcf4c8eb5ddec86dd21f676 May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-VolumesActionsTest-1329903296 May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:56:51.914448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:56:51.916733 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc9eb3074bcf4c8eb5ddec86dd21f676"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/dc9eb3074bcf4c8eb5ddec86dd21f676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_dc9eb3074bcf4c8eb5ddec86dd21f676", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/dc9eb3074bcf4c8eb5ddec86dd21f676"}]}] May 26 16:56:51.916733 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-VolumesActionsTest-1329903296 May 26 16:56:51.916733 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: dc9eb3074bcf4c8eb5ddec86dd21f676 May 26 16:56:51.916733 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-VolumesActionsTest-1329903296 May 26 16:56:51.916733 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-VolumesActionsTest-1329903296-project May 26 16:56:51.916733 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:56:51.916733 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:56:51.916733 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 14b1aff9e40a44dbabe2766d3e51f914 May 26 16:56:51.916733 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-VolumesActionsTest-1329903296-project May 26 16:56:51.916733 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 16:56:51.916733 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 88435a89-597c-4e0a-98f4-fd26adc22802 could not be found. May 26 16:56:51.916733 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '88435a89-597c-4e0a-98f4-fd26adc22802'} May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88435a89-597c-4e0a-98f4-fd26adc22802 could not be found. May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:56:51.929225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88435a89-597c-4e0a-98f4-fd26adc22802 could not be found. May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88435a89-597c-4e0a-98f4-fd26adc22802 could not be found. May 26 16:56:51.930690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:56:51.931738 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ed865f29-cb21-4f87-a3ac-c1d0f081e6eb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] Returning 404 to user: Instance 88435a89-597c-4e0a-98f4-fd26adc22802 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:56:51.931738 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ed865f29-cb21-4f87-a3ac-c1d0f081e6eb tempest-VolumesActionsTest-1329903296 tempest-VolumesActionsTest-1329903296-project] 10.222.0.48 "GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802" status: 404 len: 111 microversion: 2.1 time: 0.048640 May 26 16:56:51.931738 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 225/433] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:51 2022] GET /compute/v2.1/servers/88435a89-597c-4e0a-98f4-fd26adc22802 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:56:52.824953 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c92b5d9b-8179-48e8-8cfd-9ed78d553c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:52.825500 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c92b5d9b-8179-48e8-8cfd-9ed78d553c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:52.832732 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c92b5d9b-8179-48e8-8cfd-9ed78d553c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:52.834229 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c92b5d9b-8179-48e8-8cfd-9ed78d553c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:52.835285 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c92b5d9b-8179-48e8-8cfd-9ed78d553c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:52.835791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c92b5d9b-8179-48e8-8cfd-9ed78d553c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:53.018973 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c92b5d9b-8179-48e8-8cfd-9ed78d553c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:53.042042 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c92b5d9b-8179-48e8-8cfd-9ed78d553c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:53.042042 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c92b5d9b-8179-48e8-8cfd-9ed78d553c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:53.042042 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c92b5d9b-8179-48e8-8cfd-9ed78d553c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1750 microversion: 2.20 time: 0.213090 May 26 16:56:53.042305 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 209/434] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:52 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1750 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:53.572030 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1170729377", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f04a253f-94d5-469e-a169-e4789fc9cd70"}], "security_groups": [{"name": "tempest-securitygroup--2059437377"}], "key_name": "tempest-keypair-906685521", "user_data": "}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:56:53.696368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.network.neutron [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] validate_networks() for [('f04a253f-94d5-469e-a169-e4789fc9cd70', None, None, None, None, None)] {{(pid=124836) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:56:54.055325 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1391dd2c-8ac2-42b8-ab61-7a01d0fd0f65 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:54.056918 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1391dd2c-8ac2-42b8-ab61-7a01d0fd0f65 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:54.059735 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:54.065575 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1391dd2c-8ac2-42b8-ab61-7a01d0fd0f65 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:54.071786 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1391dd2c-8ac2-42b8-ab61-7a01d0fd0f65 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:54.073223 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1391dd2c-8ac2-42b8-ab61-7a01d0fd0f65 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:54.073908 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1391dd2c-8ac2-42b8-ab61-7a01d0fd0f65 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:54.078011 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:54.297629 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1391dd2c-8ac2-42b8-ab61-7a01d0fd0f65 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:54.306598 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1391dd2c-8ac2-42b8-ab61-7a01d0fd0f65 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:54.308143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1391dd2c-8ac2-42b8-ab61-7a01d0fd0f65 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:54.309417 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1391dd2c-8ac2-42b8-ab61-7a01d0fd0f65 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1752 microversion: 2.20 time: 0.259402 May 26 16:56:54.309987 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 210/435] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:54 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1752 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:56:54.377923 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Flavor limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:56:54.378376 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Image limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:56:54.378875 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Flavor pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:56:54.379294 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Image pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:56:54.379712 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:56:54.390568 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:54.391064 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:54.391886 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:54.392329 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:54.417405 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:56:54.424855 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for user 1551f28754a64d1d9010ed90b67c5dc4 and project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:56:54.436799 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Going to run 1 instances... {{(pid=124836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:56:54.439180 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:56:54.697001 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f900b1d9-afcb-4968-aa6b-e8a99866f1a6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.129863 May 26 16:56:54.698435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 226/436] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 16:56:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 16:56:54.718380 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-12d54e58-750b-41a9-b0e0-dfd5c46adbbe tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:54.719004 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-12d54e58-750b-41a9-b0e0-dfd5c46adbbe tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:54.781660 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-12d54e58-750b-41a9-b0e0-dfd5c46adbbe tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:54.790755 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-12d54e58-750b-41a9-b0e0-dfd5c46adbbe tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1241 microversion: 2.1 time: 0.086020 May 26 16:56:54.794870 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 211/437] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:54 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:55.328524 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5520fc46-2bd9-4874-aafd-e5d38b408e08 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:55.329252 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5520fc46-2bd9-4874-aafd-e5d38b408e08 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:55.336553 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5520fc46-2bd9-4874-aafd-e5d38b408e08 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:55.337005 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5520fc46-2bd9-4874-aafd-e5d38b408e08 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:55.337833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5520fc46-2bd9-4874-aafd-e5d38b408e08 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:55.338275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5520fc46-2bd9-4874-aafd-e5d38b408e08 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:55.472841 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5520fc46-2bd9-4874-aafd-e5d38b408e08 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:55.482180 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5520fc46-2bd9-4874-aafd-e5d38b408e08 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:55.483705 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5520fc46-2bd9-4874-aafd-e5d38b408e08 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:55.485033 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5520fc46-2bd9-4874-aafd-e5d38b408e08 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1752 microversion: 2.20 time: 0.160962 May 26 16:56:55.485609 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 227/438] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:55 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:55.808926 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ecccea8d-a4d8-45e5-924b-8fe6ff9789cc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:55.809646 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ecccea8d-a4d8-45e5-924b-8fe6ff9789cc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:55.817594 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ecccea8d-a4d8-45e5-924b-8fe6ff9789cc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:55.818093 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ecccea8d-a4d8-45e5-924b-8fe6ff9789cc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:55.818986 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ecccea8d-a4d8-45e5-924b-8fe6ff9789cc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:55.819463 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ecccea8d-a4d8-45e5-924b-8fe6ff9789cc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:55.882603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ecccea8d-a4d8-45e5-924b-8fe6ff9789cc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:55.890066 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ecccea8d-a4d8-45e5-924b-8fe6ff9789cc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1245 microversion: 2.1 time: 0.085062 May 26 16:56:55.890642 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 212/439] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:55 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:56.503967 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8618e2ea-63af-463e-ae59-192e462859a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:56.504551 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8618e2ea-63af-463e-ae59-192e462859a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:56.511664 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8618e2ea-63af-463e-ae59-192e462859a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:56.512109 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8618e2ea-63af-463e-ae59-192e462859a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:56.512897 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8618e2ea-63af-463e-ae59-192e462859a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:56.513428 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8618e2ea-63af-463e-ae59-192e462859a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:56.659949 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8618e2ea-63af-463e-ae59-192e462859a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:56.669873 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8618e2ea-63af-463e-ae59-192e462859a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:56.671146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8618e2ea-63af-463e-ae59-192e462859a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:56.672291 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8618e2ea-63af-463e-ae59-192e462859a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1752 microversion: 2.20 time: 0.172236 May 26 16:56:56.672844 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 228/440] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:56 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:56.907774 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3b229d39-16a1-4011-8d0c-7d412ca037ef tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:56.908408 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3b229d39-16a1-4011-8d0c-7d412ca037ef tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:56.916542 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b229d39-16a1-4011-8d0c-7d412ca037ef tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:56.916999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b229d39-16a1-4011-8d0c-7d412ca037ef tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:56.917828 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b229d39-16a1-4011-8d0c-7d412ca037ef tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:56.918268 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b229d39-16a1-4011-8d0c-7d412ca037ef tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:56.986607 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3b229d39-16a1-4011-8d0c-7d412ca037ef tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:56.994907 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3b229d39-16a1-4011-8d0c-7d412ca037ef tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1245 microversion: 2.1 time: 0.091650 May 26 16:56:56.995537 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 213/441] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:56 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:57.690942 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-67bdb595-c318-488d-a4f7-9be8e64ac692 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:57.691561 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-67bdb595-c318-488d-a4f7-9be8e64ac692 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:57.698933 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-67bdb595-c318-488d-a4f7-9be8e64ac692 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:57.699384 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-67bdb595-c318-488d-a4f7-9be8e64ac692 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:57.700171 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-67bdb595-c318-488d-a4f7-9be8e64ac692 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:57.700612 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-67bdb595-c318-488d-a4f7-9be8e64ac692 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:57.862478 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-67bdb595-c318-488d-a4f7-9be8e64ac692 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:57.869493 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-67bdb595-c318-488d-a4f7-9be8e64ac692 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:57.870901 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-67bdb595-c318-488d-a4f7-9be8e64ac692 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:57.872100 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-67bdb595-c318-488d-a4f7-9be8e64ac692 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1752 microversion: 2.20 time: 0.185083 May 26 16:56:57.872654 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 229/442] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:57 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:58.015981 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3193a5fb-3222-4ab0-bf43-6ae8872d7735 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:58.016596 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3193a5fb-3222-4ab0-bf43-6ae8872d7735 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:58.023927 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3193a5fb-3222-4ab0-bf43-6ae8872d7735 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:58.024380 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3193a5fb-3222-4ab0-bf43-6ae8872d7735 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:58.025155 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3193a5fb-3222-4ab0-bf43-6ae8872d7735 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:58.025619 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3193a5fb-3222-4ab0-bf43-6ae8872d7735 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:58.089832 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3193a5fb-3222-4ab0-bf43-6ae8872d7735 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:58.097803 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3193a5fb-3222-4ab0-bf43-6ae8872d7735 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1293 microversion: 2.1 time: 0.085437 May 26 16:56:58.098439 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 214/443] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:58 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:56:58.890813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e1bdf3af-48de-4f78-8160-18238e98799c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:58.891434 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e1bdf3af-48de-4f78-8160-18238e98799c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:58.899293 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e1bdf3af-48de-4f78-8160-18238e98799c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:58.899775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e1bdf3af-48de-4f78-8160-18238e98799c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:58.900535 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e1bdf3af-48de-4f78-8160-18238e98799c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:58.900971 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e1bdf3af-48de-4f78-8160-18238e98799c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:59.072041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e1bdf3af-48de-4f78-8160-18238e98799c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:59.082203 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e1bdf3af-48de-4f78-8160-18238e98799c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:59.084855 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e1bdf3af-48de-4f78-8160-18238e98799c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:59.086159 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e1bdf3af-48de-4f78-8160-18238e98799c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1752 microversion: 2.20 time: 0.199306 May 26 16:56:59.086728 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 230/444] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:56:58 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1752 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:56:59.116213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a5144f67-1b87-4db3-9a2a-82af03148527 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:56:59.117758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a5144f67-1b87-4db3-9a2a-82af03148527 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:56:59.128122 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5144f67-1b87-4db3-9a2a-82af03148527 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:59.129105 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5144f67-1b87-4db3-9a2a-82af03148527 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:59.131109 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5144f67-1b87-4db3-9a2a-82af03148527 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:56:59.131722 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5144f67-1b87-4db3-9a2a-82af03148527 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:56:59.237575 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a5144f67-1b87-4db3-9a2a-82af03148527 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:56:59.245649 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a5144f67-1b87-4db3-9a2a-82af03148527 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1299 microversion: 2.1 time: 0.134882 May 26 16:56:59.262441 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 215/445] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:56:59 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1299 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:00.111259 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a0ab2661-689d-409c-be35-754e391690b1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:00.112253 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a0ab2661-689d-409c-be35-754e391690b1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:00.163010 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a0ab2661-689d-409c-be35-754e391690b1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:00.164581 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a0ab2661-689d-409c-be35-754e391690b1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:00.170510 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a0ab2661-689d-409c-be35-754e391690b1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:00.171205 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a0ab2661-689d-409c-be35-754e391690b1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:00.280608 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-367d4d85-66f3-4eb7-8fcb-b3a7c6ec048c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:00.282122 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-367d4d85-66f3-4eb7-8fcb-b3a7c6ec048c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:00.290167 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-367d4d85-66f3-4eb7-8fcb-b3a7c6ec048c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:00.291143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-367d4d85-66f3-4eb7-8fcb-b3a7c6ec048c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:00.292497 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-367d4d85-66f3-4eb7-8fcb-b3a7c6ec048c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:00.293242 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-367d4d85-66f3-4eb7-8fcb-b3a7c6ec048c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:00.722848 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-367d4d85-66f3-4eb7-8fcb-b3a7c6ec048c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:00.733356 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-367d4d85-66f3-4eb7-8fcb-b3a7c6ec048c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1367 microversion: 2.1 time: 0.458487 May 26 16:57:00.734186 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 216/446] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:00 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1367 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:00.741474 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1795382393", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-787864708", "security_groups": [{"name": "tempest-secgroup-smoke-1078549195"}], "block_device_mapping_v2": [{"uuid": "bbc99099-1fcf-4fa6-9b2c-709191d7fd22", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3b72a37f-f6f4-40d5-aa2f-177110f74e30"}]}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:00.751876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a0ab2661-689d-409c-be35-754e391690b1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:00.763655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a0ab2661-689d-409c-be35-754e391690b1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:00.766649 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a0ab2661-689d-409c-be35-754e391690b1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:00.773077 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a0ab2661-689d-409c-be35-754e391690b1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1752 microversion: 2.20 time: 0.666582 May 26 16:57:00.782448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 231/447] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:00 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1752 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:00.937736 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] validate_networks() for [('3b72a37f-f6f4-40d5-aa2f-177110f74e30', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:57:00.984838 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-116f8ddb-97db-4397-84e4-abd5938983af req-a1db1e11-356d-4c68-a043-f5e3bd61bf93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550e0ebe-517e-452c-97bf-ac35669bab9e", "tag": "d95376b4-838e-489b-8c7d-892435fd9f18"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:01.001702 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-116f8ddb-97db-4397-84e4-abd5938983af req-a1db1e11-356d-4c68-a043-f5e3bd61bf93 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:01.002642 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-116f8ddb-97db-4397-84e4-abd5938983af req-a1db1e11-356d-4c68-a043-f5e3bd61bf93 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:01.031390 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-116f8ddb-97db-4397-84e4-abd5938983af req-a1db1e11-356d-4c68-a043-f5e3bd61bf93 service nova] Creating event network-changed:d95376b4-838e-489b-8c7d-892435fd9f18 for instance 550e0ebe-517e-452c-97bf-ac35669bab9e on hv-cinder-83607 May 26 16:57:01.040629 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-116f8ddb-97db-4397-84e4-abd5938983af req-a1db1e11-356d-4c68-a043-f5e3bd61bf93 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069964 May 26 16:57:01.041864 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 232/448] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:57:01.612667 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:57:01.613886 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:57:01.614725 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:57:01.615546 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:57:01.616214 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:57:01.628932 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:01.629637 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:01.631143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:01.631779 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:01.652987 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Getting quotas for project 895a592d480548ddb6afdb1e7c45ed92. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:57:01.659462 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Getting quotas for user 5d6ddab73db44710bcb5bba4c0cfbcfa and project 895a592d480548ddb6afdb1e7c45ed92. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:57:01.739108 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:57:01.741616 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bbc99099-1fcf-4fa6-9b2c-709191d7fd22',volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:57:01.752340 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f3d44252-1b5d-44b8-bc14-e3a1d0512ad5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:01.759137 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f3d44252-1b5d-44b8-bc14-e3a1d0512ad5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:01.781391 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f3d44252-1b5d-44b8-bc14-e3a1d0512ad5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:01.782085 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f3d44252-1b5d-44b8-bc14-e3a1d0512ad5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:01.783633 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f3d44252-1b5d-44b8-bc14-e3a1d0512ad5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:01.786298 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f3d44252-1b5d-44b8-bc14-e3a1d0512ad5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:02.022106 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f3d44252-1b5d-44b8-bc14-e3a1d0512ad5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:02.031471 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f3d44252-1b5d-44b8-bc14-e3a1d0512ad5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1367 microversion: 2.1 time: 0.283802 May 26 16:57:02.043162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 233/449] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:01 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:02.050747 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f3b1a754-0d21-4bb8-a29b-11843e8ff688 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:02.051666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f3b1a754-0d21-4bb8-a29b-11843e8ff688 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:02.060999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f3b1a754-0d21-4bb8-a29b-11843e8ff688 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:02.061804 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f3b1a754-0d21-4bb8-a29b-11843e8ff688 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:02.063096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f3b1a754-0d21-4bb8-a29b-11843e8ff688 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:02.064368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f3b1a754-0d21-4bb8-a29b-11843e8ff688 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:02.302526 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f3b1a754-0d21-4bb8-a29b-11843e8ff688 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:02.315683 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f3b1a754-0d21-4bb8-a29b-11843e8ff688 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:02.319485 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f3b1a754-0d21-4bb8-a29b-11843e8ff688 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:02.321321 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f3b1a754-0d21-4bb8-a29b-11843e8ff688 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.275948 May 26 16:57:02.322102 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 234/450] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:02 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:02.554997 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ce399a08-aa82-4282-acfb-911714331839 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.819551 May 26 16:57:02.574006 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 217/451] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 16:57:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 16:57:02.585653 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-dc72d485-78ae-45fe-9a2b-32188b83970b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:02.586818 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-dc72d485-78ae-45fe-9a2b-32188b83970b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:02.735271 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-dc72d485-78ae-45fe-9a2b-32188b83970b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:02.752417 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-dc72d485-78ae-45fe-9a2b-32188b83970b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1094 microversion: 2.1 time: 0.175655 May 26 16:57:02.754594 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 235/452] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:02 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1094 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:03.058134 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-460638b2-35e6-4479-b7b3-772d93a2fe5e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:03.058134 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-460638b2-35e6-4479-b7b3-772d93a2fe5e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:03.100646 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-460638b2-35e6-4479-b7b3-772d93a2fe5e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:03.108046 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-460638b2-35e6-4479-b7b3-772d93a2fe5e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:03.111365 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-460638b2-35e6-4479-b7b3-772d93a2fe5e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:03.116615 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-460638b2-35e6-4479-b7b3-772d93a2fe5e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:03.306287 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-460638b2-35e6-4479-b7b3-772d93a2fe5e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:03.316384 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-460638b2-35e6-4479-b7b3-772d93a2fe5e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1367 microversion: 2.1 time: 0.269097 May 26 16:57:03.317240 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 218/453] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:03 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:03.351414 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3b3a47a1-6119-449c-8d00-a9500b9746ed tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:03.352394 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3b3a47a1-6119-449c-8d00-a9500b9746ed tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:03.363433 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3b3a47a1-6119-449c-8d00-a9500b9746ed tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:03.363433 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3b3a47a1-6119-449c-8d00-a9500b9746ed tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:03.365578 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3b3a47a1-6119-449c-8d00-a9500b9746ed tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:03.365932 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3b3a47a1-6119-449c-8d00-a9500b9746ed tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:03.383268 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:03.502852 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3b3a47a1-6119-449c-8d00-a9500b9746ed tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:03.526146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3b3a47a1-6119-449c-8d00-a9500b9746ed tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:03.526146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3b3a47a1-6119-449c-8d00-a9500b9746ed tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:03.526146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3b3a47a1-6119-449c-8d00-a9500b9746ed tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.171500 May 26 16:57:03.526506 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 236/454] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:03 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:03.773298 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f6e21f98-ed3c-4247-9b6e-a1ba02ffc808 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:03.774336 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f6e21f98-ed3c-4247-9b6e-a1ba02ffc808 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:03.840829 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f6e21f98-ed3c-4247-9b6e-a1ba02ffc808 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:03.850505 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f6e21f98-ed3c-4247-9b6e-a1ba02ffc808 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1094 microversion: 2.1 time: 0.082184 May 26 16:57:03.860522 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 219/455] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:03 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:04.337509 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-33307c92-b825-45e4-ad89-467751234848 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:04.338635 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-33307c92-b825-45e4-ad89-467751234848 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:04.359591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-33307c92-b825-45e4-ad89-467751234848 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:04.360377 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-33307c92-b825-45e4-ad89-467751234848 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:04.361718 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-33307c92-b825-45e4-ad89-467751234848 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:04.362703 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-33307c92-b825-45e4-ad89-467751234848 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:04.408103 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:04.549979 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7b5fb747-be2d-4a00-b206-4b62abe7a35a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:04.549979 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7b5fb747-be2d-4a00-b206-4b62abe7a35a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:04.582523 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b5fb747-be2d-4a00-b206-4b62abe7a35a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:04.583151 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b5fb747-be2d-4a00-b206-4b62abe7a35a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:04.584077 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b5fb747-be2d-4a00-b206-4b62abe7a35a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:04.584639 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b5fb747-be2d-4a00-b206-4b62abe7a35a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:04.661185 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-33307c92-b825-45e4-ad89-467751234848 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:04.704488 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-33307c92-b825-45e4-ad89-467751234848 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1367 microversion: 2.1 time: 0.370084 May 26 16:57:04.706268 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 237/456] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:04 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:04.839959 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7b5fb747-be2d-4a00-b206-4b62abe7a35a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:04.851348 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7b5fb747-be2d-4a00-b206-4b62abe7a35a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:04.852923 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7b5fb747-be2d-4a00-b206-4b62abe7a35a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:04.854204 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7b5fb747-be2d-4a00-b206-4b62abe7a35a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.321057 May 26 16:57:04.854731 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 220/457] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:04 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:57:04.868765 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c7cb4729-e7f4-4db3-9713-44153488eb44 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:04.877792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c7cb4729-e7f4-4db3-9713-44153488eb44 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:04.877792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c7cb4729-e7f4-4db3-9713-44153488eb44 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:04.877792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c7cb4729-e7f4-4db3-9713-44153488eb44 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:04.877792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c7cb4729-e7f4-4db3-9713-44153488eb44 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:04.878355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c7cb4729-e7f4-4db3-9713-44153488eb44 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:04.963136 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c7cb4729-e7f4-4db3-9713-44153488eb44 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:04.975040 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c7cb4729-e7f4-4db3-9713-44153488eb44 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1136 microversion: 2.1 time: 0.110783 May 26 16:57:04.976151 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 238/458] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:04 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1136 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:05.726983 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-715f936e-1645-4775-85d0-a12d402286ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:05.728143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-715f936e-1645-4775-85d0-a12d402286ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:05.748477 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-715f936e-1645-4775-85d0-a12d402286ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:05.759447 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-715f936e-1645-4775-85d0-a12d402286ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:05.762781 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-715f936e-1645-4775-85d0-a12d402286ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:05.763292 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-715f936e-1645-4775-85d0-a12d402286ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:05.875515 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-0c8bd4ec-64c1-4b99-8f72-b6b9f61141d1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:05.876938 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-0c8bd4ec-64c1-4b99-8f72-b6b9f61141d1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:05.890617 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0c8bd4ec-64c1-4b99-8f72-b6b9f61141d1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:05.891506 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0c8bd4ec-64c1-4b99-8f72-b6b9f61141d1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:05.892528 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0c8bd4ec-64c1-4b99-8f72-b6b9f61141d1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:05.897108 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0c8bd4ec-64c1-4b99-8f72-b6b9f61141d1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:06.342449 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-0c8bd4ec-64c1-4b99-8f72-b6b9f61141d1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:06.354959 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-0c8bd4ec-64c1-4b99-8f72-b6b9f61141d1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:06.359094 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-0c8bd4ec-64c1-4b99-8f72-b6b9f61141d1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:06.361704 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-0c8bd4ec-64c1-4b99-8f72-b6b9f61141d1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.490458 May 26 16:57:06.375506 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 239/459] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:05 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:06.378091 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-715f936e-1645-4775-85d0-a12d402286ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:06.389026 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-715f936e-1645-4775-85d0-a12d402286ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1367 microversion: 2.1 time: 0.668237 May 26 16:57:06.394092 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ffefec90-d321-4229-933f-066b1c116a98 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:06.395207 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 221/460] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:05 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1367 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:06.397218 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ffefec90-d321-4229-933f-066b1c116a98 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:06.404981 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ffefec90-d321-4229-933f-066b1c116a98 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:06.405671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ffefec90-d321-4229-933f-066b1c116a98 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:06.406837 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ffefec90-d321-4229-933f-066b1c116a98 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:06.407373 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ffefec90-d321-4229-933f-066b1c116a98 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:06.489229 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ffefec90-d321-4229-933f-066b1c116a98 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:06.498812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ffefec90-d321-4229-933f-066b1c116a98 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1136 microversion: 2.1 time: 0.127165 May 26 16:57:06.513784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 240/461] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:06 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1136 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:07.390246 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f3c27499-77b5-42cd-a242-3f56427411a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:07.391637 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f3c27499-77b5-42cd-a242-3f56427411a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:07.399744 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f3c27499-77b5-42cd-a242-3f56427411a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:07.400583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f3c27499-77b5-42cd-a242-3f56427411a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:07.401671 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f3c27499-77b5-42cd-a242-3f56427411a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:07.402348 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f3c27499-77b5-42cd-a242-3f56427411a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:07.418988 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c4a4d00a-a168-4deb-9672-cf0ff6cd5620 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:07.420703 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c4a4d00a-a168-4deb-9672-cf0ff6cd5620 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:07.434479 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c4a4d00a-a168-4deb-9672-cf0ff6cd5620 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:07.435345 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c4a4d00a-a168-4deb-9672-cf0ff6cd5620 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:07.436432 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c4a4d00a-a168-4deb-9672-cf0ff6cd5620 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:07.437170 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c4a4d00a-a168-4deb-9672-cf0ff6cd5620 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:07.710563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c4a4d00a-a168-4deb-9672-cf0ff6cd5620 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:07.721759 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c4a4d00a-a168-4deb-9672-cf0ff6cd5620 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1367 microversion: 2.1 time: 0.307038 May 26 16:57:07.723340 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 241/462] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:07 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:07.730374 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c0c07d9a-406a-4e33-94be-874508b01573 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:07.731369 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c0c07d9a-406a-4e33-94be-874508b01573 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:07.739189 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c0c07d9a-406a-4e33-94be-874508b01573 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:07.740574 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c0c07d9a-406a-4e33-94be-874508b01573 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:07.741820 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c0c07d9a-406a-4e33-94be-874508b01573 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:07.742486 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c0c07d9a-406a-4e33-94be-874508b01573 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:07.743535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f3c27499-77b5-42cd-a242-3f56427411a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:07.757479 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f3c27499-77b5-42cd-a242-3f56427411a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:07.760579 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f3c27499-77b5-42cd-a242-3f56427411a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:07.762308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f3c27499-77b5-42cd-a242-3f56427411a6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.377201 May 26 16:57:07.763596 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 222/463] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:07 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:07.837956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c0c07d9a-406a-4e33-94be-874508b01573 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:07.846543 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c0c07d9a-406a-4e33-94be-874508b01573 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1136 microversion: 2.1 time: 0.120931 May 26 16:57:07.847183 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 242/464] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:07 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1136 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:08.754835 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c7bdd34a-d96a-41fb-bd1b-74b94b53405d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:08.756494 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c7bdd34a-d96a-41fb-bd1b-74b94b53405d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:08.766607 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c7bdd34a-d96a-41fb-bd1b-74b94b53405d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:08.767085 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c7bdd34a-d96a-41fb-bd1b-74b94b53405d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:08.768017 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c7bdd34a-d96a-41fb-bd1b-74b94b53405d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:08.768543 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c7bdd34a-d96a-41fb-bd1b-74b94b53405d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:08.803083 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4d9983f0-46f6-4426-a86f-216a221d6c09 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:08.805048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4d9983f0-46f6-4426-a86f-216a221d6c09 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:08.831932 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4d9983f0-46f6-4426-a86f-216a221d6c09 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:08.833586 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4d9983f0-46f6-4426-a86f-216a221d6c09 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:08.839540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4d9983f0-46f6-4426-a86f-216a221d6c09 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:08.842363 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4d9983f0-46f6-4426-a86f-216a221d6c09 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:08.994299 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c7bdd34a-d96a-41fb-bd1b-74b94b53405d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:09.008902 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c7bdd34a-d96a-41fb-bd1b-74b94b53405d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1367 microversion: 2.1 time: 0.258693 May 26 16:57:09.013715 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 223/465] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:08 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:09.035662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3d1debb9-12d5-429b-94df-8af580303484 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:09.040535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3d1debb9-12d5-429b-94df-8af580303484 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:09.059860 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3d1debb9-12d5-429b-94df-8af580303484 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:09.061081 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3d1debb9-12d5-429b-94df-8af580303484 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:09.062609 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3d1debb9-12d5-429b-94df-8af580303484 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:09.065100 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3d1debb9-12d5-429b-94df-8af580303484 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:09.235590 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3d1debb9-12d5-429b-94df-8af580303484 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:09.256662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3d1debb9-12d5-429b-94df-8af580303484 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1136 microversion: 2.1 time: 0.233871 May 26 16:57:09.266626 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 224/466] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:09 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1136 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:09.302850 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4d9983f0-46f6-4426-a86f-216a221d6c09 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:09.317939 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4d9983f0-46f6-4426-a86f-216a221d6c09 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:09.320257 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4d9983f0-46f6-4426-a86f-216a221d6c09 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:09.321974 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4d9983f0-46f6-4426-a86f-216a221d6c09 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.527175 May 26 16:57:09.325298 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 243/467] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:08 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:10.030762 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-aa128d15-36a8-4c65-a22e-5cf5a7e105ce tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:10.031586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-aa128d15-36a8-4c65-a22e-5cf5a7e105ce tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:10.047572 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aa128d15-36a8-4c65-a22e-5cf5a7e105ce tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:10.048274 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aa128d15-36a8-4c65-a22e-5cf5a7e105ce tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:10.049992 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aa128d15-36a8-4c65-a22e-5cf5a7e105ce tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:10.050440 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-aa128d15-36a8-4c65-a22e-5cf5a7e105ce tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:10.273606 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7e140d0c-34cd-4623-8af1-1559b6a259c4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:10.274957 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7e140d0c-34cd-4623-8af1-1559b6a259c4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:10.290626 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7e140d0c-34cd-4623-8af1-1559b6a259c4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:10.291226 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7e140d0c-34cd-4623-8af1-1559b6a259c4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:10.292401 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7e140d0c-34cd-4623-8af1-1559b6a259c4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:10.292995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7e140d0c-34cd-4623-8af1-1559b6a259c4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:10.394366 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7e140d0c-34cd-4623-8af1-1559b6a259c4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:10.403234 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7e140d0c-34cd-4623-8af1-1559b6a259c4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1192 microversion: 2.1 time: 0.134963 May 26 16:57:10.404725 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 244/468] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:10 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1192 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:10.410131 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-29d82e81-db16-48c3-8380-fa3fd30d9721 req-511675be-5652-436e-8648-c0a7785b40ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550e0ebe-517e-452c-97bf-ac35669bab9e", "name": "network-vif-plugged", "status": "completed", "tag": "d95376b4-838e-489b-8c7d-892435fd9f18"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:10.422309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-29d82e81-db16-48c3-8380-fa3fd30d9721 req-511675be-5652-436e-8648-c0a7785b40ee service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:10.423251 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-29d82e81-db16-48c3-8380-fa3fd30d9721 req-511675be-5652-436e-8648-c0a7785b40ee service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:10.440285 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-29d82e81-db16-48c3-8380-fa3fd30d9721 req-511675be-5652-436e-8648-c0a7785b40ee service nova] Creating event network-vif-plugged:d95376b4-838e-489b-8c7d-892435fd9f18 for instance 550e0ebe-517e-452c-97bf-ac35669bab9e on hv-cinder-83607 May 26 16:57:10.450293 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-29d82e81-db16-48c3-8380-fa3fd30d9721 req-511675be-5652-436e-8648-c0a7785b40ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043346 May 26 16:57:10.452195 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-aa128d15-36a8-4c65-a22e-5cf5a7e105ce tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:10.452725 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 245/469] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:57:10.463214 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6746fc96-19ff-4a54-bc7b-99084dcb39a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:10.464783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6746fc96-19ff-4a54-bc7b-99084dcb39a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:10.469169 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-aa128d15-36a8-4c65-a22e-5cf5a7e105ce tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1367 microversion: 2.1 time: 0.443111 May 26 16:57:10.484846 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6746fc96-19ff-4a54-bc7b-99084dcb39a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:10.484846 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6746fc96-19ff-4a54-bc7b-99084dcb39a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:10.484846 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6746fc96-19ff-4a54-bc7b-99084dcb39a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:10.485080 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 225/470] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:10 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1367 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:10.485182 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6746fc96-19ff-4a54-bc7b-99084dcb39a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:10.748566 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6746fc96-19ff-4a54-bc7b-99084dcb39a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:10.784288 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6746fc96-19ff-4a54-bc7b-99084dcb39a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:10.793473 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6746fc96-19ff-4a54-bc7b-99084dcb39a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:10.793473 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6746fc96-19ff-4a54-bc7b-99084dcb39a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.334416 May 26 16:57:10.793473 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 246/471] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:10 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:11.424947 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6d22a03b-23b9-4b1b-97ea-c1dae4bbc9b1 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:11.426308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6d22a03b-23b9-4b1b-97ea-c1dae4bbc9b1 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:11.435625 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6d22a03b-23b9-4b1b-97ea-c1dae4bbc9b1 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:11.444965 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6d22a03b-23b9-4b1b-97ea-c1dae4bbc9b1 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:11.444965 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6d22a03b-23b9-4b1b-97ea-c1dae4bbc9b1 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:11.444965 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6d22a03b-23b9-4b1b-97ea-c1dae4bbc9b1 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:11.496964 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-17122124-9d26-429f-837f-5d8e593cb9e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:11.496964 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-17122124-9d26-429f-837f-5d8e593cb9e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:11.514083 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-17122124-9d26-429f-837f-5d8e593cb9e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:11.514083 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-17122124-9d26-429f-837f-5d8e593cb9e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:11.514083 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-17122124-9d26-429f-837f-5d8e593cb9e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:11.514083 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-17122124-9d26-429f-837f-5d8e593cb9e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:11.641743 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:11.754745 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6d22a03b-23b9-4b1b-97ea-c1dae4bbc9b1 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:11.772054 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6d22a03b-23b9-4b1b-97ea-c1dae4bbc9b1 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1210 microversion: 2.1 time: 0.351386 May 26 16:57:11.778913 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 226/472] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:11 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1210 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:11.815047 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3ce703d4-ef23-4723-af34-03e1e04112c1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:11.815668 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3ce703d4-ef23-4723-af34-03e1e04112c1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:11.832883 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3ce703d4-ef23-4723-af34-03e1e04112c1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:11.834066 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3ce703d4-ef23-4723-af34-03e1e04112c1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:11.834876 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3ce703d4-ef23-4723-af34-03e1e04112c1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:11.835323 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3ce703d4-ef23-4723-af34-03e1e04112c1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:12.345628 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-17122124-9d26-429f-837f-5d8e593cb9e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:12.381125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-17122124-9d26-429f-837f-5d8e593cb9e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1367 microversion: 2.1 time: 0.890219 May 26 16:57:12.393051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 247/473] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:11 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1367 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:12.429022 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3ce703d4-ef23-4723-af34-03e1e04112c1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:12.441440 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3ce703d4-ef23-4723-af34-03e1e04112c1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:12.444392 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3ce703d4-ef23-4723-af34-03e1e04112c1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:12.446265 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3ce703d4-ef23-4723-af34-03e1e04112c1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.638101 May 26 16:57:12.468754 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 227/474] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:11 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:12.796819 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-bf1db75f-8859-427b-a59a-5f42734b6036 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:12.850982 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-bf1db75f-8859-427b-a59a-5f42734b6036 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:12.850982 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=12 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:12.850982 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bf1db75f-8859-427b-a59a-5f42734b6036 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:12.850982 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bf1db75f-8859-427b-a59a-5f42734b6036 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:12.852639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bf1db75f-8859-427b-a59a-5f42734b6036 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:12.852639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bf1db75f-8859-427b-a59a-5f42734b6036 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:12.917301 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-bf1db75f-8859-427b-a59a-5f42734b6036 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:12.943311 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-bf1db75f-8859-427b-a59a-5f42734b6036 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1210 microversion: 2.1 time: 0.149268 May 26 16:57:12.963000 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 248/475] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:12 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1210 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:13.405682 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0a1b0db6-7493-452b-aa05-398bb2831ce5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:13.407007 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0a1b0db6-7493-452b-aa05-398bb2831ce5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:13.427469 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0a1b0db6-7493-452b-aa05-398bb2831ce5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:13.429096 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0a1b0db6-7493-452b-aa05-398bb2831ce5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:13.431046 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0a1b0db6-7493-452b-aa05-398bb2831ce5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:13.432958 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0a1b0db6-7493-452b-aa05-398bb2831ce5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:13.486518 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-64aeaf6c-4672-4f00-b2a8-a9486dbec9cc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:13.496699 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-64aeaf6c-4672-4f00-b2a8-a9486dbec9cc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:13.526757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-64aeaf6c-4672-4f00-b2a8-a9486dbec9cc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:13.527113 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-64aeaf6c-4672-4f00-b2a8-a9486dbec9cc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:13.527979 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-64aeaf6c-4672-4f00-b2a8-a9486dbec9cc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:13.528427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-64aeaf6c-4672-4f00-b2a8-a9486dbec9cc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:13.853849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=10 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:13.909283 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0a1b0db6-7493-452b-aa05-398bb2831ce5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:13.924049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0a1b0db6-7493-452b-aa05-398bb2831ce5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1367 microversion: 2.1 time: 0.525419 May 26 16:57:13.927587 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 228/476] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:13 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1367 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:13.965832 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e635ee17-7a7d-4e2f-9b4f-c5154a5c85fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:13.966657 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e635ee17-7a7d-4e2f-9b4f-c5154a5c85fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:13.980553 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e635ee17-7a7d-4e2f-9b4f-c5154a5c85fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:13.983114 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e635ee17-7a7d-4e2f-9b4f-c5154a5c85fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:13.991080 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e635ee17-7a7d-4e2f-9b4f-c5154a5c85fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:13.991080 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e635ee17-7a7d-4e2f-9b4f-c5154a5c85fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:14.051951 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-64aeaf6c-4672-4f00-b2a8-a9486dbec9cc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:14.094662 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-64aeaf6c-4672-4f00-b2a8-a9486dbec9cc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:14.096623 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:14.110741 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-64aeaf6c-4672-4f00-b2a8-a9486dbec9cc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:14.114324 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-64aeaf6c-4672-4f00-b2a8-a9486dbec9cc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.641515 May 26 16:57:14.117840 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 249/477] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:13 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:57:14.272372 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e635ee17-7a7d-4e2f-9b4f-c5154a5c85fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:14.288857 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e635ee17-7a7d-4e2f-9b4f-c5154a5c85fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1210 microversion: 2.1 time: 0.327878 May 26 16:57:14.291729 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 229/478] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:13 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1210 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:14.962541 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e558b4ca-430c-485c-b161-cdf96dbcb38b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:14.963986 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e558b4ca-430c-485c-b161-cdf96dbcb38b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:14.980744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e558b4ca-430c-485c-b161-cdf96dbcb38b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:14.981927 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e558b4ca-430c-485c-b161-cdf96dbcb38b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:14.984336 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e558b4ca-430c-485c-b161-cdf96dbcb38b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:14.985428 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e558b4ca-430c-485c-b161-cdf96dbcb38b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:15.135606 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cbb57716-3a39-4139-9bec-f96eaf540d73 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:15.136954 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cbb57716-3a39-4139-9bec-f96eaf540d73 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:15.145214 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cbb57716-3a39-4139-9bec-f96eaf540d73 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:15.146301 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cbb57716-3a39-4139-9bec-f96eaf540d73 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:15.146750 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cbb57716-3a39-4139-9bec-f96eaf540d73 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:15.147202 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cbb57716-3a39-4139-9bec-f96eaf540d73 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:15.199205 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e558b4ca-430c-485c-b161-cdf96dbcb38b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:15.203086 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e558b4ca-430c-485c-b161-cdf96dbcb38b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1367 microversion: 2.1 time: 0.249670 May 26 16:57:15.203862 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 250/479] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:14 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:15.327018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-d26e3a13-2442-4c31-9be8-c9cca708b0e8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:15.327821 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-d26e3a13-2442-4c31-9be8-c9cca708b0e8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:15.346586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cbb57716-3a39-4139-9bec-f96eaf540d73 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:15.354443 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d26e3a13-2442-4c31-9be8-c9cca708b0e8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:15.354443 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d26e3a13-2442-4c31-9be8-c9cca708b0e8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:15.356394 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d26e3a13-2442-4c31-9be8-c9cca708b0e8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:15.357655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d26e3a13-2442-4c31-9be8-c9cca708b0e8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:15.359485 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cbb57716-3a39-4139-9bec-f96eaf540d73 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:15.361373 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cbb57716-3a39-4139-9bec-f96eaf540d73 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:15.362879 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cbb57716-3a39-4139-9bec-f96eaf540d73 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.231291 May 26 16:57:15.367701 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 230/480] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:15 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:15.480296 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d26e3a13-2442-4c31-9be8-c9cca708b0e8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:15.497315 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-d26e3a13-2442-4c31-9be8-c9cca708b0e8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1210 microversion: 2.1 time: 0.172331 May 26 16:57:15.497315 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 251/481] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:15 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1210 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:16.229926 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e4b9a0a0-a17c-4fd9-910d-12418145ed69 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:16.232030 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e4b9a0a0-a17c-4fd9-910d-12418145ed69 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:16.250679 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4b9a0a0-a17c-4fd9-910d-12418145ed69 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:16.251820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4b9a0a0-a17c-4fd9-910d-12418145ed69 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:16.253383 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4b9a0a0-a17c-4fd9-910d-12418145ed69 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:16.254355 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e4b9a0a0-a17c-4fd9-910d-12418145ed69 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:16.388667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-80c89813-f200-4625-8527-b7640ad2a95f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:16.392320 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-80c89813-f200-4625-8527-b7640ad2a95f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:16.418288 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-80c89813-f200-4625-8527-b7640ad2a95f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:16.432398 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-80c89813-f200-4625-8527-b7640ad2a95f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:16.434345 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-80c89813-f200-4625-8527-b7640ad2a95f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:16.435318 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-80c89813-f200-4625-8527-b7640ad2a95f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:16.557304 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e4b9a0a0-a17c-4fd9-910d-12418145ed69 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:16.588320 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e4b9a0a0-a17c-4fd9-910d-12418145ed69 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1367 microversion: 2.1 time: 0.371378 May 26 16:57:16.589710 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 231/482] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:16 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:16.618787 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f52ec1ef-dabe-41ba-bf0f-dfb545517122 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:16.620651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f52ec1ef-dabe-41ba-bf0f-dfb545517122 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:16.658941 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f52ec1ef-dabe-41ba-bf0f-dfb545517122 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:16.662618 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f52ec1ef-dabe-41ba-bf0f-dfb545517122 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:16.664462 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f52ec1ef-dabe-41ba-bf0f-dfb545517122 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:16.672714 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f52ec1ef-dabe-41ba-bf0f-dfb545517122 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:16.875531 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-80c89813-f200-4625-8527-b7640ad2a95f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:16.895767 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f52ec1ef-dabe-41ba-bf0f-dfb545517122 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:16.905998 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f52ec1ef-dabe-41ba-bf0f-dfb545517122 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1210 microversion: 2.1 time: 0.314594 May 26 16:57:16.906699 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 232/483] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:16 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1210 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:16.918609 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-80c89813-f200-4625-8527-b7640ad2a95f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:16.921477 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-80c89813-f200-4625-8527-b7640ad2a95f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:16.923460 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-80c89813-f200-4625-8527-b7640ad2a95f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.544453 May 26 16:57:16.924791 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 252/484] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:16 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:17.625470 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-123a9acf-6985-44fe-ae9c-67c3d0808f8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:17.627752 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-123a9acf-6985-44fe-ae9c-67c3d0808f8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:17.649614 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-123a9acf-6985-44fe-ae9c-67c3d0808f8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:17.651974 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-123a9acf-6985-44fe-ae9c-67c3d0808f8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:17.654563 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-123a9acf-6985-44fe-ae9c-67c3d0808f8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:17.657189 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-123a9acf-6985-44fe-ae9c-67c3d0808f8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:17.877389 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-123a9acf-6985-44fe-ae9c-67c3d0808f8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:17.889316 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-123a9acf-6985-44fe-ae9c-67c3d0808f8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1367 microversion: 2.1 time: 0.280153 May 26 16:57:17.897437 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 233/485] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:17 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:17.939552 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7ca57dab-33db-4e09-b1d6-441f4cf3239a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:17.943263 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7ca57dab-33db-4e09-b1d6-441f4cf3239a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:17.945194 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7603bb04-f9ca-48ba-a2c2-335130d5a860 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:17.945957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7603bb04-f9ca-48ba-a2c2-335130d5a860 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:17.956738 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7603bb04-f9ca-48ba-a2c2-335130d5a860 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:17.957365 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7603bb04-f9ca-48ba-a2c2-335130d5a860 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:17.958289 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7603bb04-f9ca-48ba-a2c2-335130d5a860 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:17.958848 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7603bb04-f9ca-48ba-a2c2-335130d5a860 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:17.960844 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7ca57dab-33db-4e09-b1d6-441f4cf3239a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:17.963287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7ca57dab-33db-4e09-b1d6-441f4cf3239a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:17.965180 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7ca57dab-33db-4e09-b1d6-441f4cf3239a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:17.969419 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7ca57dab-33db-4e09-b1d6-441f4cf3239a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:18.121235 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7ca57dab-33db-4e09-b1d6-441f4cf3239a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:18.129894 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=100 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:18.135547 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7ca57dab-33db-4e09-b1d6-441f4cf3239a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1210 microversion: 2.1 time: 0.211531 May 26 16:57:18.145649 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 253/486] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:17 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1210 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:18.212674 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7603bb04-f9ca-48ba-a2c2-335130d5a860 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:18.229108 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7603bb04-f9ca-48ba-a2c2-335130d5a860 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:18.230829 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7603bb04-f9ca-48ba-a2c2-335130d5a860 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:18.232041 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7603bb04-f9ca-48ba-a2c2-335130d5a860 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.291516 May 26 16:57:18.264234 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 234/487] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:17 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:57:18.904630 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e151e354-13ec-4d11-8a3c-4d4dc7df1a6b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:18.905274 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e151e354-13ec-4d11-8a3c-4d4dc7df1a6b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:18.912827 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e151e354-13ec-4d11-8a3c-4d4dc7df1a6b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:18.913454 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e151e354-13ec-4d11-8a3c-4d4dc7df1a6b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:18.920824 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e151e354-13ec-4d11-8a3c-4d4dc7df1a6b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:18.921694 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e151e354-13ec-4d11-8a3c-4d4dc7df1a6b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:19.092383 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e151e354-13ec-4d11-8a3c-4d4dc7df1a6b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:19.101746 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e151e354-13ec-4d11-8a3c-4d4dc7df1a6b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1367 microversion: 2.1 time: 0.201276 May 26 16:57:19.102340 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 254/488] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:18 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:19.156667 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-62c382cc-ef58-4f00-a458-4039c59cd508 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:19.157245 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-62c382cc-ef58-4f00-a458-4039c59cd508 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:19.164227 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-62c382cc-ef58-4f00-a458-4039c59cd508 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:19.164682 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-62c382cc-ef58-4f00-a458-4039c59cd508 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:19.165487 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-62c382cc-ef58-4f00-a458-4039c59cd508 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:19.165925 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-62c382cc-ef58-4f00-a458-4039c59cd508 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:19.254437 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6c0e291e-63c8-405e-96f8-4c420318a80d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:19.255695 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6c0e291e-63c8-405e-96f8-4c420318a80d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:19.268327 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:19.269387 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-62c382cc-ef58-4f00-a458-4039c59cd508 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:19.269959 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6c0e291e-63c8-405e-96f8-4c420318a80d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:19.270467 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6c0e291e-63c8-405e-96f8-4c420318a80d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:19.271255 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6c0e291e-63c8-405e-96f8-4c420318a80d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:19.271698 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6c0e291e-63c8-405e-96f8-4c420318a80d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:19.279743 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-62c382cc-ef58-4f00-a458-4039c59cd508 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1210 microversion: 2.1 time: 0.127375 May 26 16:57:19.283546 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 235/489] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:19 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1210 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:19.506591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6c0e291e-63c8-405e-96f8-4c420318a80d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:19.522278 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6c0e291e-63c8-405e-96f8-4c420318a80d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:19.527357 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6c0e291e-63c8-405e-96f8-4c420318a80d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:19.530666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6c0e291e-63c8-405e-96f8-4c420318a80d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.281509 May 26 16:57:19.532462 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 255/490] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:19 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:57:20.122809 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-91372479-d0ce-418a-865f-c90e3610abd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:20.123789 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-91372479-d0ce-418a-865f-c90e3610abd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:20.137391 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91372479-d0ce-418a-865f-c90e3610abd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:20.138890 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91372479-d0ce-418a-865f-c90e3610abd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:20.140154 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91372479-d0ce-418a-865f-c90e3610abd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:20.140869 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91372479-d0ce-418a-865f-c90e3610abd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:20.328085 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a2a08446-6c69-4ebf-b40e-0252c3ce27dc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:20.339100 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a2a08446-6c69-4ebf-b40e-0252c3ce27dc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:20.356386 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a2a08446-6c69-4ebf-b40e-0252c3ce27dc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:20.357767 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a2a08446-6c69-4ebf-b40e-0252c3ce27dc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:20.363473 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a2a08446-6c69-4ebf-b40e-0252c3ce27dc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:20.365032 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a2a08446-6c69-4ebf-b40e-0252c3ce27dc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:20.383129 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-91372479-d0ce-418a-865f-c90e3610abd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:20.410023 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-91372479-d0ce-418a-865f-c90e3610abd1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1367 microversion: 2.1 time: 0.293666 May 26 16:57:20.426317 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 236/491] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:20 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:20.554606 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e14b368d-a454-4c49-b855-2754e043ad6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:20.555479 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e14b368d-a454-4c49-b855-2754e043ad6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:20.568642 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e14b368d-a454-4c49-b855-2754e043ad6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:20.569423 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e14b368d-a454-4c49-b855-2754e043ad6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:20.570358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e14b368d-a454-4c49-b855-2754e043ad6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:20.571067 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e14b368d-a454-4c49-b855-2754e043ad6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:20.599748 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a2a08446-6c69-4ebf-b40e-0252c3ce27dc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:20.612305 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a2a08446-6c69-4ebf-b40e-0252c3ce27dc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1278 microversion: 2.1 time: 0.313315 May 26 16:57:20.624824 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 256/492] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:20 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1278 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:20.769490 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e14b368d-a454-4c49-b855-2754e043ad6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:20.788320 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e14b368d-a454-4c49-b855-2754e043ad6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:20.795126 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e14b368d-a454-4c49-b855-2754e043ad6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:20.797515 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e14b368d-a454-4c49-b855-2754e043ad6e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.248441 May 26 16:57:20.799127 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 237/493] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:20 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:21.436095 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6aa9b664-6075-4da1-a5a7-649c24896319 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:21.439341 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6aa9b664-6075-4da1-a5a7-649c24896319 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:21.445495 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6aa9b664-6075-4da1-a5a7-649c24896319 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:21.446001 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6aa9b664-6075-4da1-a5a7-649c24896319 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:21.446809 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6aa9b664-6075-4da1-a5a7-649c24896319 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:21.447241 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6aa9b664-6075-4da1-a5a7-649c24896319 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:21.589872 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-0aa7ec7c-8a4b-4ae2-8d70-a664e12e97c6 req-8881cce9-1e66-4cd5-8d70-55df53e1c79f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69fcc029-dd46-485e-8058-9d577bb0e654", "tag": "a919d060-6065-426c-982a-0881dca96a38"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:21.607052 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-0aa7ec7c-8a4b-4ae2-8d70-a664e12e97c6 req-8881cce9-1e66-4cd5-8d70-55df53e1c79f service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:21.608147 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-0aa7ec7c-8a4b-4ae2-8d70-a664e12e97c6 req-8881cce9-1e66-4cd5-8d70-55df53e1c79f service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:21.613315 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6aa9b664-6075-4da1-a5a7-649c24896319 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:21.625244 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6aa9b664-6075-4da1-a5a7-649c24896319 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1558 microversion: 2.1 time: 0.190618 May 26 16:57:21.625244 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 257/494] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:21 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1558 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:21.634654 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9dd6af3b-1fbd-4059-9e00-dd3151e305ed tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:21.635741 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9dd6af3b-1fbd-4059-9e00-dd3151e305ed tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:21.638224 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-0aa7ec7c-8a4b-4ae2-8d70-a664e12e97c6 req-8881cce9-1e66-4cd5-8d70-55df53e1c79f service nova] Creating event network-changed:a919d060-6065-426c-982a-0881dca96a38 for instance 69fcc029-dd46-485e-8058-9d577bb0e654 on hv-cinder-83607 May 26 16:57:21.644457 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-0aa7ec7c-8a4b-4ae2-8d70-a664e12e97c6 req-8881cce9-1e66-4cd5-8d70-55df53e1c79f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058073 May 26 16:57:21.647597 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 238/495] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:57:21.659950 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-61e67c8a-4fee-4b34-a065-c82919ec3850 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:21.660203 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dd6af3b-1fbd-4059-9e00-dd3151e305ed tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:21.660203 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dd6af3b-1fbd-4059-9e00-dd3151e305ed tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:21.660390 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-61e67c8a-4fee-4b34-a065-c82919ec3850 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:21.661354 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dd6af3b-1fbd-4059-9e00-dd3151e305ed tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:21.662292 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dd6af3b-1fbd-4059-9e00-dd3151e305ed tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:21.668159 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-61e67c8a-4fee-4b34-a065-c82919ec3850 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:21.668625 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-61e67c8a-4fee-4b34-a065-c82919ec3850 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:21.669442 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-61e67c8a-4fee-4b34-a065-c82919ec3850 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:21.669876 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-61e67c8a-4fee-4b34-a065-c82919ec3850 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:21.833611 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-61e67c8a-4fee-4b34-a065-c82919ec3850 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.183716 May 26 16:57:21.835501 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 239/496] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 26 16:57:21 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:57:21.871835 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e2771f13-7c86-4c94-b966-14fb060a26a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:21.871835 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e2771f13-7c86-4c94-b966-14fb060a26a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:21.871835 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2771f13-7c86-4c94-b966-14fb060a26a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:21.871835 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2771f13-7c86-4c94-b966-14fb060a26a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:21.872442 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2771f13-7c86-4c94-b966-14fb060a26a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:21.872442 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2771f13-7c86-4c94-b966-14fb060a26a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:21.953629 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9dd6af3b-1fbd-4059-9e00-dd3151e305ed tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:21.967222 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9dd6af3b-1fbd-4059-9e00-dd3151e305ed tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.337183 May 26 16:57:21.976157 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 258/497] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:21 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:22.071295 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e2771f13-7c86-4c94-b966-14fb060a26a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:22.086758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e2771f13-7c86-4c94-b966-14fb060a26a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:22.088275 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e2771f13-7c86-4c94-b966-14fb060a26a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:22.090746 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e2771f13-7c86-4c94-b966-14fb060a26a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.248012 May 26 16:57:22.091503 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 240/498] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:21 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:22.987604 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ad4a17d5-8a0e-404a-b000-e152ce59c101 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:22.988216 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ad4a17d5-8a0e-404a-b000-e152ce59c101 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:22.996411 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ad4a17d5-8a0e-404a-b000-e152ce59c101 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:22.998776 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ad4a17d5-8a0e-404a-b000-e152ce59c101 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:22.998776 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ad4a17d5-8a0e-404a-b000-e152ce59c101 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:22.998776 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ad4a17d5-8a0e-404a-b000-e152ce59c101 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:23.115817 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-55869c4e-121c-48e4-9564-df9ad69ed8aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:23.116546 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-55869c4e-121c-48e4-9564-df9ad69ed8aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:23.131098 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-55869c4e-121c-48e4-9564-df9ad69ed8aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:23.131913 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-55869c4e-121c-48e4-9564-df9ad69ed8aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:23.133233 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-55869c4e-121c-48e4-9564-df9ad69ed8aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:23.134049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-55869c4e-121c-48e4-9564-df9ad69ed8aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:23.206286 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ad4a17d5-8a0e-404a-b000-e152ce59c101 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:23.222128 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ad4a17d5-8a0e-404a-b000-e152ce59c101 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.237855 May 26 16:57:23.224183 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 259/499] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:22 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:23.318506 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-55869c4e-121c-48e4-9564-df9ad69ed8aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:23.333608 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-55869c4e-121c-48e4-9564-df9ad69ed8aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:23.335867 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-55869c4e-121c-48e4-9564-df9ad69ed8aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:23.337304 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-55869c4e-121c-48e4-9564-df9ad69ed8aa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.226431 May 26 16:57:23.339011 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 241/500] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:23 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:23.985338 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-67093b52-5240-4a32-a90d-620ac97d5c68 req-810c3901-ffb7-4e36-a3a5-5dcbe89ef017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "550e0ebe-517e-452c-97bf-ac35669bab9e", "tag": "d95376b4-838e-489b-8c7d-892435fd9f18"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:24.005561 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-67093b52-5240-4a32-a90d-620ac97d5c68 req-810c3901-ffb7-4e36-a3a5-5dcbe89ef017 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:24.006232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-67093b52-5240-4a32-a90d-620ac97d5c68 req-810c3901-ffb7-4e36-a3a5-5dcbe89ef017 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:24.018094 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-67093b52-5240-4a32-a90d-620ac97d5c68 req-810c3901-ffb7-4e36-a3a5-5dcbe89ef017 service nova] Creating event network-changed:d95376b4-838e-489b-8c7d-892435fd9f18 for instance 550e0ebe-517e-452c-97bf-ac35669bab9e on hv-cinder-83607 May 26 16:57:24.024537 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-67093b52-5240-4a32-a90d-620ac97d5c68 req-810c3901-ffb7-4e36-a3a5-5dcbe89ef017 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043260 May 26 16:57:24.025332 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 260/501] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:57:24.245154 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c9c953cb-54ab-4c4a-8081-60854f38ff8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:24.246629 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c9c953cb-54ab-4c4a-8081-60854f38ff8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:24.254332 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9c953cb-54ab-4c4a-8081-60854f38ff8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:24.255648 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9c953cb-54ab-4c4a-8081-60854f38ff8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:24.256506 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9c953cb-54ab-4c4a-8081-60854f38ff8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:24.257295 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c9c953cb-54ab-4c4a-8081-60854f38ff8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:24.363796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f37467e6-fe20-4239-8273-bdccb3f8d709 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:24.365033 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f37467e6-fe20-4239-8273-bdccb3f8d709 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:24.373438 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f37467e6-fe20-4239-8273-bdccb3f8d709 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:24.374140 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f37467e6-fe20-4239-8273-bdccb3f8d709 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:24.375180 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f37467e6-fe20-4239-8273-bdccb3f8d709 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:24.375774 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f37467e6-fe20-4239-8273-bdccb3f8d709 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:24.439057 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c9c953cb-54ab-4c4a-8081-60854f38ff8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:24.455663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c9c953cb-54ab-4c4a-8081-60854f38ff8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.215449 May 26 16:57:24.460433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 242/502] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:24 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:24.541300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f37467e6-fe20-4239-8273-bdccb3f8d709 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:24.563568 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f37467e6-fe20-4239-8273-bdccb3f8d709 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:24.566264 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f37467e6-fe20-4239-8273-bdccb3f8d709 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:24.568656 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f37467e6-fe20-4239-8273-bdccb3f8d709 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.214388 May 26 16:57:24.569202 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 261/503] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:24 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:57:25.475789 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0d9e27a5-729e-40f4-a189-23af07bc09d0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:25.476505 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0d9e27a5-729e-40f4-a189-23af07bc09d0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:25.483349 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0d9e27a5-729e-40f4-a189-23af07bc09d0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:25.483797 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0d9e27a5-729e-40f4-a189-23af07bc09d0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:25.484607 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0d9e27a5-729e-40f4-a189-23af07bc09d0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:25.485167 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0d9e27a5-729e-40f4-a189-23af07bc09d0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:25.588935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-93d170b1-b612-4023-976e-4526efd97a63 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:25.589730 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-93d170b1-b612-4023-976e-4526efd97a63 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:25.600351 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-93d170b1-b612-4023-976e-4526efd97a63 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:25.601442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-93d170b1-b612-4023-976e-4526efd97a63 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:25.602537 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-93d170b1-b612-4023-976e-4526efd97a63 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:25.604046 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-93d170b1-b612-4023-976e-4526efd97a63 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:25.840502 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0d9e27a5-729e-40f4-a189-23af07bc09d0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:25.850105 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0d9e27a5-729e-40f4-a189-23af07bc09d0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.379189 May 26 16:57:25.851024 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 243/504] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:25 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:25.898873 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-93d170b1-b612-4023-976e-4526efd97a63 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:25.913240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-93d170b1-b612-4023-976e-4526efd97a63 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:25.917992 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-93d170b1-b612-4023-976e-4526efd97a63 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:25.920322 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-93d170b1-b612-4023-976e-4526efd97a63 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.336357 May 26 16:57:25.923042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 262/505] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:25 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:57:26.868758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-77fc59e1-253f-4810-b4e0-1c96411e7e16 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:26.869393 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-77fc59e1-253f-4810-b4e0-1c96411e7e16 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:26.876878 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77fc59e1-253f-4810-b4e0-1c96411e7e16 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:26.877390 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77fc59e1-253f-4810-b4e0-1c96411e7e16 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:26.878198 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77fc59e1-253f-4810-b4e0-1c96411e7e16 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:26.878642 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77fc59e1-253f-4810-b4e0-1c96411e7e16 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:26.944444 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9b382c2e-f360-4f11-a660-f4414bbf83c7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:26.946392 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9b382c2e-f360-4f11-a660-f4414bbf83c7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:26.955296 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b382c2e-f360-4f11-a660-f4414bbf83c7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:26.955827 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b382c2e-f360-4f11-a660-f4414bbf83c7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:26.956623 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b382c2e-f360-4f11-a660-f4414bbf83c7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:26.957060 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b382c2e-f360-4f11-a660-f4414bbf83c7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:27.093719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-77fc59e1-253f-4810-b4e0-1c96411e7e16 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:27.105428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-77fc59e1-253f-4810-b4e0-1c96411e7e16 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.240663 May 26 16:57:27.107670 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 244/506] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:26 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:27.157454 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9b382c2e-f360-4f11-a660-f4414bbf83c7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:27.169101 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9b382c2e-f360-4f11-a660-f4414bbf83c7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:27.171066 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9b382c2e-f360-4f11-a660-f4414bbf83c7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:27.172406 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9b382c2e-f360-4f11-a660-f4414bbf83c7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.234221 May 26 16:57:27.173122 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 263/507] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:26 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:57:28.123264 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-65d432fe-329e-45bf-a686-6617bef49000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:28.124201 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-65d432fe-329e-45bf-a686-6617bef49000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:28.126896 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:28.132306 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-65d432fe-329e-45bf-a686-6617bef49000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:28.132858 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-65d432fe-329e-45bf-a686-6617bef49000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:28.133705 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-65d432fe-329e-45bf-a686-6617bef49000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:28.143792 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-65d432fe-329e-45bf-a686-6617bef49000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:28.200124 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-faedb08b-96f7-4bc2-90e1-07bfdcb39f0c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:28.200911 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-faedb08b-96f7-4bc2-90e1-07bfdcb39f0c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:28.208747 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-faedb08b-96f7-4bc2-90e1-07bfdcb39f0c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:28.209389 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-faedb08b-96f7-4bc2-90e1-07bfdcb39f0c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:28.210309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-faedb08b-96f7-4bc2-90e1-07bfdcb39f0c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:28.210898 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-faedb08b-96f7-4bc2-90e1-07bfdcb39f0c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:28.335706 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-65d432fe-329e-45bf-a686-6617bef49000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:28.344690 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-65d432fe-329e-45bf-a686-6617bef49000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.225212 May 26 16:57:28.353367 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 245/508] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:28 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:28.384130 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-faedb08b-96f7-4bc2-90e1-07bfdcb39f0c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:28.394708 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-faedb08b-96f7-4bc2-90e1-07bfdcb39f0c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:28.396471 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-faedb08b-96f7-4bc2-90e1-07bfdcb39f0c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:28.397742 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-faedb08b-96f7-4bc2-90e1-07bfdcb39f0c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.201497 May 26 16:57:28.398301 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 264/509] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:28 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:29.334623 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ca6bae19-ddcc-47a2-83c7-b0d648fc2ad2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "485580ff-a759-4eba-a022-fb9d4043a653"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:29.335846 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ca6bae19-ddcc-47a2-83c7-b0d648fc2ad2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:29.343058 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca6bae19-ddcc-47a2-83c7-b0d648fc2ad2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:29.343501 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca6bae19-ddcc-47a2-83c7-b0d648fc2ad2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:29.344287 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca6bae19-ddcc-47a2-83c7-b0d648fc2ad2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:29.344721 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca6bae19-ddcc-47a2-83c7-b0d648fc2ad2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:29.362102 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e6e43870-35af-497a-b8a9-78a00c9c8fba tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:29.362754 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e6e43870-35af-497a-b8a9-78a00c9c8fba tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:29.369536 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e6e43870-35af-497a-b8a9-78a00c9c8fba tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:29.369992 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e6e43870-35af-497a-b8a9-78a00c9c8fba tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:29.370798 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e6e43870-35af-497a-b8a9-78a00c9c8fba tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:29.371241 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e6e43870-35af-497a-b8a9-78a00c9c8fba tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:29.514878 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e6e43870-35af-497a-b8a9-78a00c9c8fba tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:29.523376 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e6e43870-35af-497a-b8a9-78a00c9c8fba tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.165010 May 26 16:57:29.523963 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 265/510] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:29 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:29.528508 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3cddc425-e12b-4649-b144-c6f4bba0bbd5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:29.529108 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3cddc425-e12b-4649-b144-c6f4bba0bbd5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:29.535407 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3cddc425-e12b-4649-b144-c6f4bba0bbd5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:29.535856 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3cddc425-e12b-4649-b144-c6f4bba0bbd5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:29.536624 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3cddc425-e12b-4649-b144-c6f4bba0bbd5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:29.537059 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3cddc425-e12b-4649-b144-c6f4bba0bbd5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:29.558905 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:29.680930 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3cddc425-e12b-4649-b144-c6f4bba0bbd5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:29.690315 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3cddc425-e12b-4649-b144-c6f4bba0bbd5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:29.691815 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3cddc425-e12b-4649-b144-c6f4bba0bbd5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:29.693591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3cddc425-e12b-4649-b144-c6f4bba0bbd5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.168670 May 26 16:57:29.694146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 266/511] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:29 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:30.212002 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ca6bae19-ddcc-47a2-83c7-b0d648fc2ad2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "POST /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.881595 May 26 16:57:30.212982 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 246/512] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 26 16:57:29 2022] POST /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-volume_attachments => generated 194 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:57:30.542680 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9aab07a4-2e89-446c-8d9d-16399377cbec tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:30.543261 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9aab07a4-2e89-446c-8d9d-16399377cbec tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:30.552262 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9aab07a4-2e89-446c-8d9d-16399377cbec tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:30.552727 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9aab07a4-2e89-446c-8d9d-16399377cbec tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:30.553742 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9aab07a4-2e89-446c-8d9d-16399377cbec tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:30.554201 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9aab07a4-2e89-446c-8d9d-16399377cbec tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:30.712144 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9aab07a4-2e89-446c-8d9d-16399377cbec tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:30.718266 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6dafcd59-1700-4dee-8760-c3c08cc19dee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:30.719060 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6dafcd59-1700-4dee-8760-c3c08cc19dee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:30.726902 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9aab07a4-2e89-446c-8d9d-16399377cbec tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.188841 May 26 16:57:30.729812 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6dafcd59-1700-4dee-8760-c3c08cc19dee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:30.730953 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6dafcd59-1700-4dee-8760-c3c08cc19dee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:30.732986 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6dafcd59-1700-4dee-8760-c3c08cc19dee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:30.733752 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6dafcd59-1700-4dee-8760-c3c08cc19dee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:30.745996 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 267/513] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:30 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:30.895244 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6dafcd59-1700-4dee-8760-c3c08cc19dee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:30.907871 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6dafcd59-1700-4dee-8760-c3c08cc19dee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:30.909706 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6dafcd59-1700-4dee-8760-c3c08cc19dee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:30.911309 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6dafcd59-1700-4dee-8760-c3c08cc19dee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.201230 May 26 16:57:30.917434 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 247/514] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:30 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:31.744221 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5c9efc33-1696-43f4-851a-a54358f04b9d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:31.744870 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5c9efc33-1696-43f4-851a-a54358f04b9d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:31.752872 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5c9efc33-1696-43f4-851a-a54358f04b9d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:31.753355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5c9efc33-1696-43f4-851a-a54358f04b9d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:31.754146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5c9efc33-1696-43f4-851a-a54358f04b9d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:31.755094 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5c9efc33-1696-43f4-851a-a54358f04b9d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:31.924713 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5c9efc33-1696-43f4-851a-a54358f04b9d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:31.933407 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5c9efc33-1696-43f4-851a-a54358f04b9d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.192968 May 26 16:57:31.933609 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-dd319982-d3bb-4854-a492-82e01b8615ee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:31.944893 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-dd319982-d3bb-4854-a492-82e01b8615ee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:31.945223 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 268/515] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:31 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:31.945340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd319982-d3bb-4854-a492-82e01b8615ee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:31.945340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd319982-d3bb-4854-a492-82e01b8615ee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:31.945340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd319982-d3bb-4854-a492-82e01b8615ee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:31.945340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd319982-d3bb-4854-a492-82e01b8615ee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:32.103285 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-dd319982-d3bb-4854-a492-82e01b8615ee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:32.117612 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-dd319982-d3bb-4854-a492-82e01b8615ee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:32.119313 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-dd319982-d3bb-4854-a492-82e01b8615ee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:32.120663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-dd319982-d3bb-4854-a492-82e01b8615ee tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.192186 May 26 16:57:32.121285 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 248/516] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:31 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:32.166814 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-da3798a2-eb03-462c-87de-b25d9f8ae25b req-6a514cba-97f6-43ab-a3de-da540e9becdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0daf7ae-8eab-479b-b4cb-380a68f5bfaa", "name": "network-vif-plugged", "status": "completed", "tag": "19f830e3-9d14-4893-a727-3c20d5993b34"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:32.175596 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-da3798a2-eb03-462c-87de-b25d9f8ae25b req-6a514cba-97f6-43ab-a3de-da540e9becdb service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:32.176418 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-da3798a2-eb03-462c-87de-b25d9f8ae25b req-6a514cba-97f6-43ab-a3de-da540e9becdb service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:32.191937 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-da3798a2-eb03-462c-87de-b25d9f8ae25b req-6a514cba-97f6-43ab-a3de-da540e9becdb service nova] Creating event network-vif-plugged:19f830e3-9d14-4893-a727-3c20d5993b34 for instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa on hv-cinder-83607 May 26 16:57:32.197052 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-da3798a2-eb03-462c-87de-b25d9f8ae25b req-6a514cba-97f6-43ab-a3de-da540e9becdb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034006 May 26 16:57:32.197687 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 269/517] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:57:32.960422 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e38dc12d-24e8-4914-9218-4a22b91b31be tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:32.961882 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e38dc12d-24e8-4914-9218-4a22b91b31be tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:32.969010 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e38dc12d-24e8-4914-9218-4a22b91b31be tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:32.969485 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e38dc12d-24e8-4914-9218-4a22b91b31be tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:32.970253 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e38dc12d-24e8-4914-9218-4a22b91b31be tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:32.970689 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e38dc12d-24e8-4914-9218-4a22b91b31be tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:33.131563 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e38dc12d-24e8-4914-9218-4a22b91b31be tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:33.140856 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b3d5f80a-9f48-4bbb-8702-e4b6efef4ec4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:33.141593 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b3d5f80a-9f48-4bbb-8702-e4b6efef4ec4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:33.149615 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b3d5f80a-9f48-4bbb-8702-e4b6efef4ec4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:33.149995 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e38dc12d-24e8-4914-9218-4a22b91b31be tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.193359 May 26 16:57:33.150797 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 249/518] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:32 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:33.150930 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b3d5f80a-9f48-4bbb-8702-e4b6efef4ec4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:33.152016 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b3d5f80a-9f48-4bbb-8702-e4b6efef4ec4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:33.152632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b3d5f80a-9f48-4bbb-8702-e4b6efef4ec4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:33.300860 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b3d5f80a-9f48-4bbb-8702-e4b6efef4ec4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:33.309669 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b3d5f80a-9f48-4bbb-8702-e4b6efef4ec4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:33.311175 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b3d5f80a-9f48-4bbb-8702-e4b6efef4ec4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:33.312341 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b3d5f80a-9f48-4bbb-8702-e4b6efef4ec4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.175894 May 26 16:57:33.312892 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 270/519] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:33 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:34.171387 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2cc76892-5b4b-45d5-8ab1-d736b8d72474 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:34.173694 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2cc76892-5b4b-45d5-8ab1-d736b8d72474 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:34.184996 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2cc76892-5b4b-45d5-8ab1-d736b8d72474 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:34.185917 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2cc76892-5b4b-45d5-8ab1-d736b8d72474 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:34.187182 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2cc76892-5b4b-45d5-8ab1-d736b8d72474 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:34.187923 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2cc76892-5b4b-45d5-8ab1-d736b8d72474 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:34.331853 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-705d60e3-5f69-4390-93e5-7fd787da9ef4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:34.333825 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-705d60e3-5f69-4390-93e5-7fd787da9ef4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:34.346034 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-705d60e3-5f69-4390-93e5-7fd787da9ef4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:34.346705 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-705d60e3-5f69-4390-93e5-7fd787da9ef4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:34.349157 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-705d60e3-5f69-4390-93e5-7fd787da9ef4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:34.350793 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-705d60e3-5f69-4390-93e5-7fd787da9ef4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:34.381361 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2cc76892-5b4b-45d5-8ab1-d736b8d72474 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:34.392791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2cc76892-5b4b-45d5-8ab1-d736b8d72474 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.228040 May 26 16:57:34.393522 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 250/520] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:34 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:34.576844 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-705d60e3-5f69-4390-93e5-7fd787da9ef4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:34.579307 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=100 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:34.587195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-705d60e3-5f69-4390-93e5-7fd787da9ef4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:34.598496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-705d60e3-5f69-4390-93e5-7fd787da9ef4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:34.598496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-705d60e3-5f69-4390-93e5-7fd787da9ef4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.263077 May 26 16:57:34.598496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 271/521] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:34 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:57:35.415175 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6e941cd3-b295-4974-9d62-5585a002a377 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:35.415790 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6e941cd3-b295-4974-9d62-5585a002a377 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:35.422691 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6e941cd3-b295-4974-9d62-5585a002a377 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:35.423148 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6e941cd3-b295-4974-9d62-5585a002a377 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:35.423939 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6e941cd3-b295-4974-9d62-5585a002a377 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:35.424382 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6e941cd3-b295-4974-9d62-5585a002a377 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:35.597494 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6e941cd3-b295-4974-9d62-5585a002a377 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:35.605961 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6e941cd3-b295-4974-9d62-5585a002a377 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.195171 May 26 16:57:35.606862 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 251/522] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:35 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:35.619207 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-50076e51-2dd4-4433-864c-3bc412529136 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:35.619837 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-50076e51-2dd4-4433-864c-3bc412529136 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:35.627908 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-50076e51-2dd4-4433-864c-3bc412529136 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:35.627908 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-50076e51-2dd4-4433-864c-3bc412529136 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:35.628455 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-50076e51-2dd4-4433-864c-3bc412529136 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:35.628912 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-50076e51-2dd4-4433-864c-3bc412529136 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:35.802655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-50076e51-2dd4-4433-864c-3bc412529136 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:35.811761 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-50076e51-2dd4-4433-864c-3bc412529136 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:35.813394 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-50076e51-2dd4-4433-864c-3bc412529136 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:35.814561 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-50076e51-2dd4-4433-864c-3bc412529136 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.199923 May 26 16:57:35.815116 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 272/523] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:35 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:36.622562 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-36190a7d-4ce2-4a4e-b215-fbdcb9401894 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:36.623170 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-36190a7d-4ce2-4a4e-b215-fbdcb9401894 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:36.630896 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-36190a7d-4ce2-4a4e-b215-fbdcb9401894 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:36.631347 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-36190a7d-4ce2-4a4e-b215-fbdcb9401894 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:36.633462 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-36190a7d-4ce2-4a4e-b215-fbdcb9401894 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:36.633462 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-36190a7d-4ce2-4a4e-b215-fbdcb9401894 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:36.784141 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-36190a7d-4ce2-4a4e-b215-fbdcb9401894 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:36.806130 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-36190a7d-4ce2-4a4e-b215-fbdcb9401894 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.186497 May 26 16:57:36.813346 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 252/524] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:36 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:36.837535 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9ee95e10-3e3f-4f61-b270-a40ba4709dd3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:36.838146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9ee95e10-3e3f-4f61-b270-a40ba4709dd3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:36.848109 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9ee95e10-3e3f-4f61-b270-a40ba4709dd3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:36.848109 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9ee95e10-3e3f-4f61-b270-a40ba4709dd3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:36.848109 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9ee95e10-3e3f-4f61-b270-a40ba4709dd3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:36.848109 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9ee95e10-3e3f-4f61-b270-a40ba4709dd3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:36.954458 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-d48e4511-5759-40b7-bceb-ae010e91c5b4 req-bfe17162-2d01-4a73-aeff-e81f1f319e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69fcc029-dd46-485e-8058-9d577bb0e654", "name": "network-vif-plugged", "status": "completed", "tag": "a919d060-6065-426c-982a-0881dca96a38"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:36.965353 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-d48e4511-5759-40b7-bceb-ae010e91c5b4 req-bfe17162-2d01-4a73-aeff-e81f1f319e6a service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:36.965986 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-d48e4511-5759-40b7-bceb-ae010e91c5b4 req-bfe17162-2d01-4a73-aeff-e81f1f319e6a service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:36.978269 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-d48e4511-5759-40b7-bceb-ae010e91c5b4 req-bfe17162-2d01-4a73-aeff-e81f1f319e6a service nova] Creating event network-vif-plugged:a919d060-6065-426c-982a-0881dca96a38 for instance 69fcc029-dd46-485e-8058-9d577bb0e654 on hv-cinder-83607 May 26 16:57:36.983366 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-d48e4511-5759-40b7-bceb-ae010e91c5b4 req-bfe17162-2d01-4a73-aeff-e81f1f319e6a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033310 May 26 16:57:36.984223 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 253/525] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:57:37.001778 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9ee95e10-3e3f-4f61-b270-a40ba4709dd3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:37.011198 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9ee95e10-3e3f-4f61-b270-a40ba4709dd3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:37.012730 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9ee95e10-3e3f-4f61-b270-a40ba4709dd3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:37.013917 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9ee95e10-3e3f-4f61-b270-a40ba4709dd3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1808 microversion: 2.20 time: 0.181808 May 26 16:57:37.014470 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 273/526] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:36 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:37.827517 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-74309ba3-1cea-46b4-ac9d-d3cf22583479 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:37.828207 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-74309ba3-1cea-46b4-ac9d-d3cf22583479 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:37.838697 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-74309ba3-1cea-46b4-ac9d-d3cf22583479 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:37.838895 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-74309ba3-1cea-46b4-ac9d-d3cf22583479 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:37.839667 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-74309ba3-1cea-46b4-ac9d-d3cf22583479 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:37.840102 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-74309ba3-1cea-46b4-ac9d-d3cf22583479 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:37.996176 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-74309ba3-1cea-46b4-ac9d-d3cf22583479 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:38.005294 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-74309ba3-1cea-46b4-ac9d-d3cf22583479 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.182729 May 26 16:57:38.006358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 254/527] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:37 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:38.034163 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e5e99ad9-1ba7-4c98-b204-6ae333ff5e33 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:38.034712 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e5e99ad9-1ba7-4c98-b204-6ae333ff5e33 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:38.042057 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5e99ad9-1ba7-4c98-b204-6ae333ff5e33 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:38.042510 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5e99ad9-1ba7-4c98-b204-6ae333ff5e33 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:38.043311 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5e99ad9-1ba7-4c98-b204-6ae333ff5e33 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:38.043754 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5e99ad9-1ba7-4c98-b204-6ae333ff5e33 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:38.183655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e5e99ad9-1ba7-4c98-b204-6ae333ff5e33 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:38.193163 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e5e99ad9-1ba7-4c98-b204-6ae333ff5e33 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:38.194722 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e5e99ad9-1ba7-4c98-b204-6ae333ff5e33 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:38.195934 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e5e99ad9-1ba7-4c98-b204-6ae333ff5e33 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1795 microversion: 2.20 time: 0.166029 May 26 16:57:38.196501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 274/528] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:57:38 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1795 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:57:39.025060 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7fcaf98b-3c31-469e-8039-f04d987b7d55 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:39.025851 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7fcaf98b-3c31-469e-8039-f04d987b7d55 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:39.032753 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7fcaf98b-3c31-469e-8039-f04d987b7d55 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:39.033321 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7fcaf98b-3c31-469e-8039-f04d987b7d55 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:39.034093 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7fcaf98b-3c31-469e-8039-f04d987b7d55 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:39.034532 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7fcaf98b-3c31-469e-8039-f04d987b7d55 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:39.180523 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7fcaf98b-3c31-469e-8039-f04d987b7d55 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:39.188188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7fcaf98b-3c31-469e-8039-f04d987b7d55 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.168092 May 26 16:57:39.188761 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 255/529] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:39 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:40.206569 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9e0da8e6-fca3-467c-866e-c8f5f91f9a0a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:40.207777 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9e0da8e6-fca3-467c-866e-c8f5f91f9a0a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:40.214896 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9e0da8e6-fca3-467c-866e-c8f5f91f9a0a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:40.215259 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9e0da8e6-fca3-467c-866e-c8f5f91f9a0a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:40.216039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9e0da8e6-fca3-467c-866e-c8f5f91f9a0a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:40.216477 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9e0da8e6-fca3-467c-866e-c8f5f91f9a0a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:40.354979 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9e0da8e6-fca3-467c-866e-c8f5f91f9a0a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:40.364348 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9e0da8e6-fca3-467c-866e-c8f5f91f9a0a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1266 microversion: 2.1 time: 0.162033 May 26 16:57:40.365164 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 275/530] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:40 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:41.383175 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a59ba097-bc2e-4d32-9fde-3a03e7e2fffe tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:41.383931 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a59ba097-bc2e-4d32-9fde-3a03e7e2fffe tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:41.390892 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a59ba097-bc2e-4d32-9fde-3a03e7e2fffe tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:41.391334 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a59ba097-bc2e-4d32-9fde-3a03e7e2fffe tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:41.392115 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a59ba097-bc2e-4d32-9fde-3a03e7e2fffe tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:41.392547 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a59ba097-bc2e-4d32-9fde-3a03e7e2fffe tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:41.542953 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a59ba097-bc2e-4d32-9fde-3a03e7e2fffe tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:41.550765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a59ba097-bc2e-4d32-9fde-3a03e7e2fffe tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1452 microversion: 2.1 time: 0.172363 May 26 16:57:41.552918 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 256/531] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:41 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:41.576263 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f0cbb534-23db-4e1e-91e9-4e44eefb993b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:41.585110 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f0cbb534-23db-4e1e-91e9-4e44eefb993b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:41.586900 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f0cbb534-23db-4e1e-91e9-4e44eefb993b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:41.587938 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f0cbb534-23db-4e1e-91e9-4e44eefb993b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:41.588689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f0cbb534-23db-4e1e-91e9-4e44eefb993b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:41.589148 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f0cbb534-23db-4e1e-91e9-4e44eefb993b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:41.753802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f0cbb534-23db-4e1e-91e9-4e44eefb993b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:41.763188 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f0cbb534-23db-4e1e-91e9-4e44eefb993b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1452 microversion: 2.1 time: 0.191318 May 26 16:57:41.763789 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 276/532] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:41 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1452 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:42.219177 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-abe3d98c-6030-4756-8d87-794d73c002b4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:42.220166 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-abe3d98c-6030-4756-8d87-794d73c002b4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:42.228928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-abe3d98c-6030-4756-8d87-794d73c002b4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:42.229606 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-abe3d98c-6030-4756-8d87-794d73c002b4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:42.230571 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-abe3d98c-6030-4756-8d87-794d73c002b4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:42.231110 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-abe3d98c-6030-4756-8d87-794d73c002b4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:42.260811 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-abe3d98c-6030-4756-8d87-794d73c002b4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lazy-loading 'flavor' on Instance uuid 8efc5100-c116-4608-a1d9-26e418e0609e {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:57:42.782799 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-abe3d98c-6030-4756-8d87-794d73c002b4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "POST /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/action" status: 200 len: 32 microversion: 2.1 time: 0.567685 May 26 16:57:42.784072 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 257/533] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 26 16:57:42 2022] POST /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/action => generated 32 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 16:57:42.794331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2f7921ab-b303-4c66-abc1-b16dc36fac04 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:42.794948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2f7921ab-b303-4c66-abc1-b16dc36fac04 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:42.805172 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2f7921ab-b303-4c66-abc1-b16dc36fac04 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:42.807465 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2f7921ab-b303-4c66-abc1-b16dc36fac04 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:42.808155 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2f7921ab-b303-4c66-abc1-b16dc36fac04 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:42.808595 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2f7921ab-b303-4c66-abc1-b16dc36fac04 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:43.077109 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2f7921ab-b303-4c66-abc1-b16dc36fac04 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:43.095797 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2f7921ab-b303-4c66-abc1-b16dc36fac04 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.304803 May 26 16:57:43.097944 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 277/534] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:42 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:43.256247 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9a4e3e60-6799-4b06-a52f-a1852f1ceb98 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:43.261102 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9a4e3e60-6799-4b06-a52f-a1852f1ceb98 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:43.264307 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a4e3e60-6799-4b06-a52f-a1852f1ceb98 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:43.264768 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a4e3e60-6799-4b06-a52f-a1852f1ceb98 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:43.265750 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a4e3e60-6799-4b06-a52f-a1852f1ceb98 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:43.266370 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a4e3e60-6799-4b06-a52f-a1852f1ceb98 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:43.526860 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-9a4e3e60-6799-4b06-a52f-a1852f1ceb98 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lazy-loading 'services' on Instance uuid e432ca18-47de-4981-bc37-036d927a5c62 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:57:43.901156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9a4e3e60-6799-4b06-a52f-a1852f1ceb98 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/os-volume_attachments/25c6e31e-2d91-4bfa-a93f-1ad9d5ec37f9" status: 202 len: 0 microversion: 2.1 time: 0.649604 May 26 16:57:43.906459 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 258/535] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 26 16:57:43 2022] DELETE /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/os-volume_attachments/25c6e31e-2d91-4bfa-a93f-1ad9d5ec37f9 => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:57:44.117228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4d1e1b6c-79bb-464b-b0c5-2030e5a08626 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:44.118215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4d1e1b6c-79bb-464b-b0c5-2030e5a08626 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:44.125833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4d1e1b6c-79bb-464b-b0c5-2030e5a08626 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:44.126215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4d1e1b6c-79bb-464b-b0c5-2030e5a08626 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:44.127529 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4d1e1b6c-79bb-464b-b0c5-2030e5a08626 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:44.128006 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4d1e1b6c-79bb-464b-b0c5-2030e5a08626 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:44.356960 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4d1e1b6c-79bb-464b-b0c5-2030e5a08626 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:44.365668 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4d1e1b6c-79bb-464b-b0c5-2030e5a08626 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.254606 May 26 16:57:44.368199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 278/536] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:44 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:44.831960 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-7e3417c4-959a-481d-89bc-a60477baba01 req-fbda087c-389e-4629-a8a3-2a8286794a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69fcc029-dd46-485e-8058-9d577bb0e654", "tag": "a919d060-6065-426c-982a-0881dca96a38"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:44.831960 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-7e3417c4-959a-481d-89bc-a60477baba01 req-fbda087c-389e-4629-a8a3-2a8286794a0c service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:44.832913 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-7e3417c4-959a-481d-89bc-a60477baba01 req-fbda087c-389e-4629-a8a3-2a8286794a0c service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:44.844442 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-7e3417c4-959a-481d-89bc-a60477baba01 req-fbda087c-389e-4629-a8a3-2a8286794a0c service nova] Creating event network-changed:a919d060-6065-426c-982a-0881dca96a38 for instance 69fcc029-dd46-485e-8058-9d577bb0e654 on hv-cinder-83607 May 26 16:57:44.853603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-7e3417c4-959a-481d-89bc-a60477baba01 req-fbda087c-389e-4629-a8a3-2a8286794a0c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034857 May 26 16:57:44.854429 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 259/537] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:57:45.390795 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9122c12a-da7a-442f-848d-84d0933aa182 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:45.391750 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9122c12a-da7a-442f-848d-84d0933aa182 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:45.399510 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9122c12a-da7a-442f-848d-84d0933aa182 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:45.400209 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9122c12a-da7a-442f-848d-84d0933aa182 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:45.401402 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9122c12a-da7a-442f-848d-84d0933aa182 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:45.402072 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9122c12a-da7a-442f-848d-84d0933aa182 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:45.553035 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9122c12a-da7a-442f-848d-84d0933aa182 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:45.561740 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9122c12a-da7a-442f-848d-84d0933aa182 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.174868 May 26 16:57:45.562437 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 279/538] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:45 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:46.184677 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a0821853-e4e6-499e-a9d9-c39be6c2f216 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:57:46.192442 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a0821853-e4e6-499e-a9d9-c39be6c2f216 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:46.192621 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a0821853-e4e6-499e-a9d9-c39be6c2f216 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:46.303202 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a0821853-e4e6-499e-a9d9-c39be6c2f216 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Going to try to stop instance {{(pid=124837) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 16:57:46.318159 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:46.549333 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a0821853-e4e6-499e-a9d9-c39be6c2f216 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "POST /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/action" status: 202 len: 0 microversion: 2.1 time: 0.371190 May 26 16:57:46.549937 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 260/539] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 26 16:57:46 2022] POST /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:57:46.558504 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8432177c-c905-436e-aa3b-baee82b6adf6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:46.559425 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8432177c-c905-436e-aa3b-baee82b6adf6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:46.565729 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8432177c-c905-436e-aa3b-baee82b6adf6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:46.566223 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8432177c-c905-436e-aa3b-baee82b6adf6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:46.567695 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8432177c-c905-436e-aa3b-baee82b6adf6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:46.568140 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8432177c-c905-436e-aa3b-baee82b6adf6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:46.583979 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7c5f5a26-d9d3-411f-a1f4-7f8090a72da5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:46.585384 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7c5f5a26-d9d3-411f-a1f4-7f8090a72da5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:46.593894 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7c5f5a26-d9d3-411f-a1f4-7f8090a72da5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:46.594475 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7c5f5a26-d9d3-411f-a1f4-7f8090a72da5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:46.595520 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7c5f5a26-d9d3-411f-a1f4-7f8090a72da5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:46.596084 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7c5f5a26-d9d3-411f-a1f4-7f8090a72da5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:46.780021 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8432177c-c905-436e-aa3b-baee82b6adf6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:46.787026 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7c5f5a26-d9d3-411f-a1f4-7f8090a72da5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:46.788114 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8432177c-c905-436e-aa3b-baee82b6adf6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.233577 May 26 16:57:46.788622 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 280/540] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:46 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:46.796512 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7c5f5a26-d9d3-411f-a1f4-7f8090a72da5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.219491 May 26 16:57:46.807714 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 261/541] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:46 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:47.806106 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-871a0df6-7d95-4b5d-9570-eaf139d8290b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:47.806746 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-871a0df6-7d95-4b5d-9570-eaf139d8290b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:47.813388 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-871a0df6-7d95-4b5d-9570-eaf139d8290b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:47.813837 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-871a0df6-7d95-4b5d-9570-eaf139d8290b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:47.814116 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-076199c7-391f-4de2-a164-06bfbb44c915 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:47.814603 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-871a0df6-7d95-4b5d-9570-eaf139d8290b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:47.814744 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-076199c7-391f-4de2-a164-06bfbb44c915 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:47.815037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-871a0df6-7d95-4b5d-9570-eaf139d8290b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:47.822791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-076199c7-391f-4de2-a164-06bfbb44c915 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:47.823250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-076199c7-391f-4de2-a164-06bfbb44c915 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:47.824041 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-076199c7-391f-4de2-a164-06bfbb44c915 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:47.824482 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-076199c7-391f-4de2-a164-06bfbb44c915 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:48.009883 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-871a0df6-7d95-4b5d-9570-eaf139d8290b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:48.016923 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-076199c7-391f-4de2-a164-06bfbb44c915 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:48.020632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-871a0df6-7d95-4b5d-9570-eaf139d8290b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.217808 May 26 16:57:48.021359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 281/542] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:47 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:48.026377 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-076199c7-391f-4de2-a164-06bfbb44c915 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.216104 May 26 16:57:48.026954 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 262/543] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:47 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:49.038410 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ebdb56b0-ca7e-4e6a-bf10-4ea46a9a3229 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:49.039031 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ebdb56b0-ca7e-4e6a-bf10-4ea46a9a3229 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:49.045953 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5a32ebc9-e6ab-436c-8722-3b1105c3f6f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:49.046581 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ebdb56b0-ca7e-4e6a-bf10-4ea46a9a3229 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:49.046581 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ebdb56b0-ca7e-4e6a-bf10-4ea46a9a3229 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:49.047150 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5a32ebc9-e6ab-436c-8722-3b1105c3f6f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:49.047319 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ebdb56b0-ca7e-4e6a-bf10-4ea46a9a3229 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:49.047829 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ebdb56b0-ca7e-4e6a-bf10-4ea46a9a3229 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:49.057606 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5a32ebc9-e6ab-436c-8722-3b1105c3f6f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:49.058361 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5a32ebc9-e6ab-436c-8722-3b1105c3f6f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:49.059689 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5a32ebc9-e6ab-436c-8722-3b1105c3f6f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:49.060435 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5a32ebc9-e6ab-436c-8722-3b1105c3f6f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:49.290572 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ebdb56b0-ca7e-4e6a-bf10-4ea46a9a3229 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:49.293732 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5a32ebc9-e6ab-436c-8722-3b1105c3f6f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:49.298456 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ebdb56b0-ca7e-4e6a-bf10-4ea46a9a3229 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.263887 May 26 16:57:49.299139 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 282/544] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:49 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:49.303042 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5a32ebc9-e6ab-436c-8722-3b1105c3f6f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.263167 May 26 16:57:49.303668 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 263/545] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:49 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:50.322140 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-dec5d303-d47a-453b-92b9-048a914184b0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:50.323299 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-dec5d303-d47a-453b-92b9-048a914184b0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:50.332933 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-133ac6de-91de-406c-83ea-1c17634c7a84 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:50.332933 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-133ac6de-91de-406c-83ea-1c17634c7a84 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:50.333598 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dec5d303-d47a-453b-92b9-048a914184b0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:50.333598 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dec5d303-d47a-453b-92b9-048a914184b0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:50.334464 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dec5d303-d47a-453b-92b9-048a914184b0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:50.334948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dec5d303-d47a-453b-92b9-048a914184b0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:50.340227 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-133ac6de-91de-406c-83ea-1c17634c7a84 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:50.340672 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-133ac6de-91de-406c-83ea-1c17634c7a84 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:50.341479 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-133ac6de-91de-406c-83ea-1c17634c7a84 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:50.341910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-133ac6de-91de-406c-83ea-1c17634c7a84 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:50.535148 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-dec5d303-d47a-453b-92b9-048a914184b0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:50.543857 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-dec5d303-d47a-453b-92b9-048a914184b0 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.225796 May 26 16:57:50.544446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 283/546] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:50 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:50.547988 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-133ac6de-91de-406c-83ea-1c17634c7a84 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:50.556667 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-133ac6de-91de-406c-83ea-1c17634c7a84 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.231791 May 26 16:57:50.557531 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 264/547] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:50 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:51.561126 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-51153308-2995-4572-be74-d0609bcfb855 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:51.561820 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-51153308-2995-4572-be74-d0609bcfb855 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:51.564121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=58 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:51.569668 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-51153308-2995-4572-be74-d0609bcfb855 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:51.570120 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-51153308-2995-4572-be74-d0609bcfb855 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:51.570949 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-51153308-2995-4572-be74-d0609bcfb855 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:51.571324 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-51153308-2995-4572-be74-d0609bcfb855 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:51.574832 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5510fb95-cec5-42c4-8255-0a45718ff210 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:51.575595 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5510fb95-cec5-42c4-8255-0a45718ff210 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:51.583892 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5510fb95-cec5-42c4-8255-0a45718ff210 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:51.584415 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5510fb95-cec5-42c4-8255-0a45718ff210 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:51.585322 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5510fb95-cec5-42c4-8255-0a45718ff210 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:51.585901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5510fb95-cec5-42c4-8255-0a45718ff210 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:51.779404 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-51153308-2995-4572-be74-d0609bcfb855 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:51.788701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-51153308-2995-4572-be74-d0609bcfb855 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.231643 May 26 16:57:51.789609 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 284/548] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:51 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:51.795457 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5510fb95-cec5-42c4-8255-0a45718ff210 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:51.804479 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5510fb95-cec5-42c4-8255-0a45718ff210 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.233697 May 26 16:57:51.805089 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 265/549] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:51 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:52.807888 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8ea762da-fbf7-4635-a58a-0c23328945c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:52.808576 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8ea762da-fbf7-4635-a58a-0c23328945c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:52.815263 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ea762da-fbf7-4635-a58a-0c23328945c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:52.815703 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ea762da-fbf7-4635-a58a-0c23328945c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:52.816562 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ea762da-fbf7-4635-a58a-0c23328945c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:52.817058 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ea762da-fbf7-4635-a58a-0c23328945c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:52.823160 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b56c5623-7b2b-4e65-867c-e0e006b9e6ea tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:52.823743 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b56c5623-7b2b-4e65-867c-e0e006b9e6ea tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:52.830439 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b56c5623-7b2b-4e65-867c-e0e006b9e6ea tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:52.837279 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b56c5623-7b2b-4e65-867c-e0e006b9e6ea tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:52.837279 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b56c5623-7b2b-4e65-867c-e0e006b9e6ea tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:52.837279 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b56c5623-7b2b-4e65-867c-e0e006b9e6ea tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:53.033365 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8ea762da-fbf7-4635-a58a-0c23328945c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:53.038130 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b56c5623-7b2b-4e65-867c-e0e006b9e6ea tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:53.042355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8ea762da-fbf7-4635-a58a-0c23328945c4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.238661 May 26 16:57:53.042936 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 285/550] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:52 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:53.052127 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b56c5623-7b2b-4e65-867c-e0e006b9e6ea tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.232838 May 26 16:57:53.052769 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 266/551] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:52 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:54.059845 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f66ebf77-4c16-4df0-ae20-ca7699c0aebd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:54.060481 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f66ebf77-4c16-4df0-ae20-ca7699c0aebd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:54.067765 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f66ebf77-4c16-4df0-ae20-ca7699c0aebd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:54.068225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f66ebf77-4c16-4df0-ae20-ca7699c0aebd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:54.069124 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f66ebf77-4c16-4df0-ae20-ca7699c0aebd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:54.069620 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f66ebf77-4c16-4df0-ae20-ca7699c0aebd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:54.070023 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d67b88a3-d7c2-41b7-b076-5d02e80c9d00 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:54.070657 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d67b88a3-d7c2-41b7-b076-5d02e80c9d00 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:54.080473 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d67b88a3-d7c2-41b7-b076-5d02e80c9d00 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:54.080924 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d67b88a3-d7c2-41b7-b076-5d02e80c9d00 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:54.081765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d67b88a3-d7c2-41b7-b076-5d02e80c9d00 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:54.082294 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d67b88a3-d7c2-41b7-b076-5d02e80c9d00 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:54.268817 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f66ebf77-4c16-4df0-ae20-ca7699c0aebd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:54.276957 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f66ebf77-4c16-4df0-ae20-ca7699c0aebd tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.221195 May 26 16:57:54.277634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 286/552] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:54 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:54.293168 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d67b88a3-d7c2-41b7-b076-5d02e80c9d00 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:54.301689 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d67b88a3-d7c2-41b7-b076-5d02e80c9d00 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.235411 May 26 16:57:54.302533 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 267/553] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:54 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:55.294500 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-bf2fa148-4774-4962-8f7f-b0869387bf79 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:55.295116 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-bf2fa148-4774-4962-8f7f-b0869387bf79 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:55.305227 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bf2fa148-4774-4962-8f7f-b0869387bf79 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:55.305736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bf2fa148-4774-4962-8f7f-b0869387bf79 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:55.306655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bf2fa148-4774-4962-8f7f-b0869387bf79 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:55.307101 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bf2fa148-4774-4962-8f7f-b0869387bf79 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:55.323408 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-34830a8c-7da8-4bb7-82cd-3fe1734ea702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:55.324163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-34830a8c-7da8-4bb7-82cd-3fe1734ea702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:55.331228 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34830a8c-7da8-4bb7-82cd-3fe1734ea702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:55.331735 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34830a8c-7da8-4bb7-82cd-3fe1734ea702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:55.332473 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34830a8c-7da8-4bb7-82cd-3fe1734ea702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:55.332912 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34830a8c-7da8-4bb7-82cd-3fe1734ea702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:55.513790 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-bf2fa148-4774-4962-8f7f-b0869387bf79 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:55.527851 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-bf2fa148-4774-4962-8f7f-b0869387bf79 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.236507 May 26 16:57:55.528882 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 287/554] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:55 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:55.529472 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-34830a8c-7da8-4bb7-82cd-3fe1734ea702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:55.539924 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-34830a8c-7da8-4bb7-82cd-3fe1734ea702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.223917 May 26 16:57:55.540504 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 268/555] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:55 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:56.550899 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-be01cef0-f51a-4ca2-8785-3dc7100ed2f6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:56.551603 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-be01cef0-f51a-4ca2-8785-3dc7100ed2f6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:56.557177 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-be061752-fbd4-4bab-b7ca-f518887f0b3e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:56.557943 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-be061752-fbd4-4bab-b7ca-f518887f0b3e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:56.558522 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-be01cef0-f51a-4ca2-8785-3dc7100ed2f6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:56.558980 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-be01cef0-f51a-4ca2-8785-3dc7100ed2f6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:56.559750 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-be01cef0-f51a-4ca2-8785-3dc7100ed2f6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:56.560188 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-be01cef0-f51a-4ca2-8785-3dc7100ed2f6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:56.564774 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be061752-fbd4-4bab-b7ca-f518887f0b3e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:56.565228 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be061752-fbd4-4bab-b7ca-f518887f0b3e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:56.566208 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be061752-fbd4-4bab-b7ca-f518887f0b3e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:56.566732 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-be061752-fbd4-4bab-b7ca-f518887f0b3e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:56.575801 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=100 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:56.765086 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-be01cef0-f51a-4ca2-8785-3dc7100ed2f6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:56.768882 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-be061752-fbd4-4bab-b7ca-f518887f0b3e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:56.773032 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-be01cef0-f51a-4ca2-8785-3dc7100ed2f6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.225901 May 26 16:57:56.773525 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 288/556] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:56 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:56.779749 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-be061752-fbd4-4bab-b7ca-f518887f0b3e tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.226432 May 26 16:57:56.780447 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 269/557] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:56 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:57.790548 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-04f4601a-46aa-41db-8372-9b8b476a2012 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:57.791186 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-04f4601a-46aa-41db-8372-9b8b476a2012 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:57.798100 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-04f4601a-46aa-41db-8372-9b8b476a2012 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:57.798662 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-04f4601a-46aa-41db-8372-9b8b476a2012 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:57.799530 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-04f4601a-46aa-41db-8372-9b8b476a2012 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:57.799970 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-04f4601a-46aa-41db-8372-9b8b476a2012 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:57.802014 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-09870420-4dee-4907-8a02-862e87a7813a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:57.802707 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-09870420-4dee-4907-8a02-862e87a7813a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:57.809369 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-09870420-4dee-4907-8a02-862e87a7813a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:57.809822 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-09870420-4dee-4907-8a02-862e87a7813a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:57.810590 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-09870420-4dee-4907-8a02-862e87a7813a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:57.811030 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-09870420-4dee-4907-8a02-862e87a7813a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:57.997224 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-04f4601a-46aa-41db-8372-9b8b476a2012 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:58.004895 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-09870420-4dee-4907-8a02-862e87a7813a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:58.005975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-04f4601a-46aa-41db-8372-9b8b476a2012 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.219258 May 26 16:57:58.006566 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 289/558] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:57 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:58.013229 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-09870420-4dee-4907-8a02-862e87a7813a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.215256 May 26 16:57:58.013833 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 270/559] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:57 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:57:59.025742 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-cc5a11ef-df46-43b5-81a0-6ca55cd517fe tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:59.026845 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-cc5a11ef-df46-43b5-81a0-6ca55cd517fe tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:59.033102 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ed93c7ac-f1a7-4aa4-b232-286da24a54e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:57:59.033893 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ed93c7ac-f1a7-4aa4-b232-286da24a54e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:57:59.034358 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cc5a11ef-df46-43b5-81a0-6ca55cd517fe tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:59.034817 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cc5a11ef-df46-43b5-81a0-6ca55cd517fe tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:59.035593 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cc5a11ef-df46-43b5-81a0-6ca55cd517fe tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:59.036034 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cc5a11ef-df46-43b5-81a0-6ca55cd517fe tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:59.036695 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=52 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:59.041801 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed93c7ac-f1a7-4aa4-b232-286da24a54e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:59.042258 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed93c7ac-f1a7-4aa4-b232-286da24a54e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:59.043038 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed93c7ac-f1a7-4aa4-b232-286da24a54e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:57:59.043482 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed93c7ac-f1a7-4aa4-b232-286da24a54e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:57:59.250940 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-cc5a11ef-df46-43b5-81a0-6ca55cd517fe tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:59.253578 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ed93c7ac-f1a7-4aa4-b232-286da24a54e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:57:59.262467 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-cc5a11ef-df46-43b5-81a0-6ca55cd517fe tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.242859 May 26 16:57:59.263371 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 290/560] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:59 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:57:59.263589 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ed93c7ac-f1a7-4aa4-b232-286da24a54e5 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.234010 May 26 16:57:59.264495 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 271/561] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:57:59 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:00.287524 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5fc69739-31fc-40fd-8b92-9d658a5cc341 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:00.288074 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7b556dad-cfae-4829-9721-ab1cf9832951 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:00.288449 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5fc69739-31fc-40fd-8b92-9d658a5cc341 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:00.288548 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7b556dad-cfae-4829-9721-ab1cf9832951 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:00.294450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5fc69739-31fc-40fd-8b92-9d658a5cc341 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:00.294898 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5fc69739-31fc-40fd-8b92-9d658a5cc341 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:00.295247 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b556dad-cfae-4829-9721-ab1cf9832951 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:00.295671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5fc69739-31fc-40fd-8b92-9d658a5cc341 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:00.295780 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b556dad-cfae-4829-9721-ab1cf9832951 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:00.296130 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5fc69739-31fc-40fd-8b92-9d658a5cc341 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:00.296802 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b556dad-cfae-4829-9721-ab1cf9832951 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:00.297328 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7b556dad-cfae-4829-9721-ab1cf9832951 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:00.496293 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5fc69739-31fc-40fd-8b92-9d658a5cc341 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:00.500704 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7b556dad-cfae-4829-9721-ab1cf9832951 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:00.509435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5fc69739-31fc-40fd-8b92-9d658a5cc341 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.226495 May 26 16:58:00.510618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 291/562] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:00 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:00.514276 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7b556dad-cfae-4829-9721-ab1cf9832951 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.231308 May 26 16:58:00.515028 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 272/563] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:00 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:01.530503 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4b30404f-ed33-4886-a441-af406ec5b201 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:01.537313 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5c7c00d3-2846-4863-886e-b969073c1c6c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:01.537937 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5c7c00d3-2846-4863-886e-b969073c1c6c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:01.541546 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4b30404f-ed33-4886-a441-af406ec5b201 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:01.550056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4b30404f-ed33-4886-a441-af406ec5b201 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:01.551200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4b30404f-ed33-4886-a441-af406ec5b201 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:01.552007 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4b30404f-ed33-4886-a441-af406ec5b201 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:01.552426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4b30404f-ed33-4886-a441-af406ec5b201 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:01.560101 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5c7c00d3-2846-4863-886e-b969073c1c6c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:01.560101 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5c7c00d3-2846-4863-886e-b969073c1c6c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:01.560101 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5c7c00d3-2846-4863-886e-b969073c1c6c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:01.560101 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5c7c00d3-2846-4863-886e-b969073c1c6c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:01.765579 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5c7c00d3-2846-4863-886e-b969073c1c6c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:01.773898 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4b30404f-ed33-4886-a441-af406ec5b201 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:01.774840 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5c7c00d3-2846-4863-886e-b969073c1c6c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.241932 May 26 16:58:01.775555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 273/564] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:01 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:01.791146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4b30404f-ed33-4886-a441-af406ec5b201 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.264515 May 26 16:58:01.791146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 292/565] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:01 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:02.798551 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9ae141de-c597-4205-884b-be2d07126879 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:02.800039 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9ae141de-c597-4205-884b-be2d07126879 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:02.811682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6dbb0d39-ac40-40a1-bd7f-5db0018d53d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:02.814616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6dbb0d39-ac40-40a1-bd7f-5db0018d53d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:02.825115 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6dbb0d39-ac40-40a1-bd7f-5db0018d53d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:02.825694 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6dbb0d39-ac40-40a1-bd7f-5db0018d53d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:02.829477 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6dbb0d39-ac40-40a1-bd7f-5db0018d53d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:02.829477 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6dbb0d39-ac40-40a1-bd7f-5db0018d53d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:02.831470 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ae141de-c597-4205-884b-be2d07126879 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:02.832316 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ae141de-c597-4205-884b-be2d07126879 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:02.834128 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ae141de-c597-4205-884b-be2d07126879 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:02.835146 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ae141de-c597-4205-884b-be2d07126879 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:03.024389 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6dbb0d39-ac40-40a1-bd7f-5db0018d53d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:03.032197 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6dbb0d39-ac40-40a1-bd7f-5db0018d53d1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.228108 May 26 16:58:03.033059 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 293/566] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:02 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:03.061359 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9ae141de-c597-4205-884b-be2d07126879 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:03.085067 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9ae141de-c597-4205-884b-be2d07126879 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.296159 May 26 16:58:03.087584 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 274/567] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:02 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:04.050987 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-159a997c-21d0-48f2-b90b-4295131c817e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:04.052452 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-159a997c-21d0-48f2-b90b-4295131c817e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:04.062117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-159a997c-21d0-48f2-b90b-4295131c817e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:04.062566 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-159a997c-21d0-48f2-b90b-4295131c817e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:04.063401 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-159a997c-21d0-48f2-b90b-4295131c817e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:04.063861 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-159a997c-21d0-48f2-b90b-4295131c817e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:04.106742 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8dcf6587-fc55-4e7d-b2c0-675c63b76ff9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:04.107289 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8dcf6587-fc55-4e7d-b2c0-675c63b76ff9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:04.114683 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8dcf6587-fc55-4e7d-b2c0-675c63b76ff9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:04.120739 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8dcf6587-fc55-4e7d-b2c0-675c63b76ff9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:04.120739 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8dcf6587-fc55-4e7d-b2c0-675c63b76ff9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:04.120739 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8dcf6587-fc55-4e7d-b2c0-675c63b76ff9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:04.287479 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-159a997c-21d0-48f2-b90b-4295131c817e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:04.296142 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-159a997c-21d0-48f2-b90b-4295131c817e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.249691 May 26 16:58:04.297533 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 294/568] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:04 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:04.322020 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8dcf6587-fc55-4e7d-b2c0-675c63b76ff9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:04.335590 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8dcf6587-fc55-4e7d-b2c0-675c63b76ff9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.233025 May 26 16:58:04.336579 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 275/569] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:04 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:05.314563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a5ce9c2b-5284-43b3-9733-4c9e353326f4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:05.315254 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a5ce9c2b-5284-43b3-9733-4c9e353326f4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:05.322819 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a5ce9c2b-5284-43b3-9733-4c9e353326f4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.323275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a5ce9c2b-5284-43b3-9733-4c9e353326f4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.324056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a5ce9c2b-5284-43b3-9733-4c9e353326f4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.324503 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a5ce9c2b-5284-43b3-9733-4c9e353326f4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.360151 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d3733fed-2af1-4311-845b-e32b129501c4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:05.365744 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d3733fed-2af1-4311-845b-e32b129501c4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:05.372820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d3733fed-2af1-4311-845b-e32b129501c4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.374403 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d3733fed-2af1-4311-845b-e32b129501c4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.374403 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d3733fed-2af1-4311-845b-e32b129501c4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:05.374630 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d3733fed-2af1-4311-845b-e32b129501c4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:05.525741 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a5ce9c2b-5284-43b3-9733-4c9e353326f4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:05.534604 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a5ce9c2b-5284-43b3-9733-4c9e353326f4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1675 microversion: 2.1 time: 0.223916 May 26 16:58:05.535217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 295/570] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:05 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1675 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:05.556727 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d3733fed-2af1-4311-845b-e32b129501c4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:05.559039 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:05.565574 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d3733fed-2af1-4311-845b-e32b129501c4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.209368 May 26 16:58:05.566807 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 276/571] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:05 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:06.552090 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-986b719d-4453-414b-9ec7-cb80bf37e958 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:06.552836 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-986b719d-4453-414b-9ec7-cb80bf37e958 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:06.559622 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-986b719d-4453-414b-9ec7-cb80bf37e958 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:06.560077 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-986b719d-4453-414b-9ec7-cb80bf37e958 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:06.560845 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-986b719d-4453-414b-9ec7-cb80bf37e958 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:06.561313 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-986b719d-4453-414b-9ec7-cb80bf37e958 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:06.584520 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-777883f7-077b-46dd-b7d3-cc2e17501cd0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:06.585170 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-777883f7-077b-46dd-b7d3-cc2e17501cd0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:06.592557 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-777883f7-077b-46dd-b7d3-cc2e17501cd0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:06.592985 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-777883f7-077b-46dd-b7d3-cc2e17501cd0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:06.593782 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-777883f7-077b-46dd-b7d3-cc2e17501cd0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:06.594403 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-777883f7-077b-46dd-b7d3-cc2e17501cd0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:06.746375 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-986b719d-4453-414b-9ec7-cb80bf37e958 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:06.754636 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-986b719d-4453-414b-9ec7-cb80bf37e958 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1652 microversion: 2.1 time: 0.205774 May 26 16:58:06.765186 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 296/572] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:06 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1652 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:06.771802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-0b494b41-fad2-45b1-9fe1-f24aba422618 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:06.777922 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0b494b41-fad2-45b1-9fe1-f24aba422618 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:06.778365 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0b494b41-fad2-45b1-9fe1-f24aba422618 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:06.778467 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-777883f7-077b-46dd-b7d3-cc2e17501cd0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:06.787256 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-777883f7-077b-46dd-b7d3-cc2e17501cd0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.207266 May 26 16:58:06.787829 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 277/573] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:06 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:06.801838 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-0b494b41-fad2-45b1-9fe1-f24aba422618 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Going to try to start instance {{(pid=124836) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 16:58:07.075118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-0b494b41-fad2-45b1-9fe1-f24aba422618 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "POST /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/action" status: 202 len: 0 microversion: 2.1 time: 0.306453 May 26 16:58:07.076385 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 297/574] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 26 16:58:06 2022] POST /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 16:58:07.084908 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b0a7ebcd-45e1-45af-ab4d-d3eb7fb34f72 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:07.085558 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b0a7ebcd-45e1-45af-ab4d-d3eb7fb34f72 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:07.092179 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0a7ebcd-45e1-45af-ab4d-d3eb7fb34f72 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:07.092638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0a7ebcd-45e1-45af-ab4d-d3eb7fb34f72 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:07.093455 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0a7ebcd-45e1-45af-ab4d-d3eb7fb34f72 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:07.093901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0a7ebcd-45e1-45af-ab4d-d3eb7fb34f72 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:07.238352 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b0a7ebcd-45e1-45af-ab4d-d3eb7fb34f72 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:07.246800 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b0a7ebcd-45e1-45af-ab4d-d3eb7fb34f72 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1661 microversion: 2.1 time: 0.166288 May 26 16:58:07.248081 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 278/575] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:07 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1661 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:07.805349 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-13fdddf0-3bf9-488a-a1ae-e4b6982a3cf8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:07.806308 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-13fdddf0-3bf9-488a-a1ae-e4b6982a3cf8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:07.812870 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-13fdddf0-3bf9-488a-a1ae-e4b6982a3cf8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:07.813628 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-13fdddf0-3bf9-488a-a1ae-e4b6982a3cf8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:07.814411 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-13fdddf0-3bf9-488a-a1ae-e4b6982a3cf8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:07.814854 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-13fdddf0-3bf9-488a-a1ae-e4b6982a3cf8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:07.966540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-13fdddf0-3bf9-488a-a1ae-e4b6982a3cf8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:07.975596 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-13fdddf0-3bf9-488a-a1ae-e4b6982a3cf8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.175170 May 26 16:58:07.985751 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 298/576] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:07 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:08.272538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6a54b9bd-8de9-44f9-8454-2068ced22e48 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:08.273161 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6a54b9bd-8de9-44f9-8454-2068ced22e48 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:08.279750 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6a54b9bd-8de9-44f9-8454-2068ced22e48 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:08.280291 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6a54b9bd-8de9-44f9-8454-2068ced22e48 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:08.281059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6a54b9bd-8de9-44f9-8454-2068ced22e48 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:08.281479 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6a54b9bd-8de9-44f9-8454-2068ced22e48 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:08.431059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6a54b9bd-8de9-44f9-8454-2068ced22e48 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:08.439393 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6a54b9bd-8de9-44f9-8454-2068ced22e48 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1661 microversion: 2.1 time: 0.171312 May 26 16:58:08.439986 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 279/577] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:08 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1661 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:08.995915 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3298b4a2-89e8-4efe-8de5-d696a9928d21 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:08.997706 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3298b4a2-89e8-4efe-8de5-d696a9928d21 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:09.007449 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3298b4a2-89e8-4efe-8de5-d696a9928d21 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:09.012691 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3298b4a2-89e8-4efe-8de5-d696a9928d21 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:09.012691 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3298b4a2-89e8-4efe-8de5-d696a9928d21 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:09.012691 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3298b4a2-89e8-4efe-8de5-d696a9928d21 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:09.218930 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3298b4a2-89e8-4efe-8de5-d696a9928d21 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:09.230792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3298b4a2-89e8-4efe-8de5-d696a9928d21 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.240382 May 26 16:58:09.231363 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 299/578] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:08 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:09.458715 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9e11f7b7-2c47-4928-9bca-5ce6fa796161 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:09.459308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9e11f7b7-2c47-4928-9bca-5ce6fa796161 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:09.466144 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9e11f7b7-2c47-4928-9bca-5ce6fa796161 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:09.466680 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9e11f7b7-2c47-4928-9bca-5ce6fa796161 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:09.467448 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9e11f7b7-2c47-4928-9bca-5ce6fa796161 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:09.467879 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9e11f7b7-2c47-4928-9bca-5ce6fa796161 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:09.620297 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9e11f7b7-2c47-4928-9bca-5ce6fa796161 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:09.628916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9e11f7b7-2c47-4928-9bca-5ce6fa796161 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1661 microversion: 2.1 time: 0.174141 May 26 16:58:09.629697 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 280/579] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:09 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1661 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:10.248538 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9534514b-8a61-40c6-83c5-7bbcba07a5ad tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:10.249972 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9534514b-8a61-40c6-83c5-7bbcba07a5ad tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:10.261100 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9534514b-8a61-40c6-83c5-7bbcba07a5ad tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:10.263067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9534514b-8a61-40c6-83c5-7bbcba07a5ad tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:10.264401 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9534514b-8a61-40c6-83c5-7bbcba07a5ad tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:10.265299 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9534514b-8a61-40c6-83c5-7bbcba07a5ad tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:10.453425 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9534514b-8a61-40c6-83c5-7bbcba07a5ad tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:10.463039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9534514b-8a61-40c6-83c5-7bbcba07a5ad tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1737 microversion: 2.1 time: 0.218621 May 26 16:58:10.465636 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 300/580] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:10 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:10.655340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0e1939e6-77f7-43b7-8784-2caaf20b2cc8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:10.656066 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0e1939e6-77f7-43b7-8784-2caaf20b2cc8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:10.663260 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0e1939e6-77f7-43b7-8784-2caaf20b2cc8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:10.663706 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0e1939e6-77f7-43b7-8784-2caaf20b2cc8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:10.664617 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0e1939e6-77f7-43b7-8784-2caaf20b2cc8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:10.664910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0e1939e6-77f7-43b7-8784-2caaf20b2cc8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:10.860144 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0e1939e6-77f7-43b7-8784-2caaf20b2cc8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:10.860144 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0e1939e6-77f7-43b7-8784-2caaf20b2cc8 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1661 microversion: 2.1 time: 0.203165 May 26 16:58:10.860144 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 281/581] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:10 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1661 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:11.482106 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-288b3bc7-0de8-4d2c-8649-b1dbbadc1506 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:11.482741 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-288b3bc7-0de8-4d2c-8649-b1dbbadc1506 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:11.490387 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-288b3bc7-0de8-4d2c-8649-b1dbbadc1506 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:11.490846 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-288b3bc7-0de8-4d2c-8649-b1dbbadc1506 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:11.491647 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-288b3bc7-0de8-4d2c-8649-b1dbbadc1506 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:11.492085 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-288b3bc7-0de8-4d2c-8649-b1dbbadc1506 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:11.676719 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-288b3bc7-0de8-4d2c-8649-b1dbbadc1506 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:11.687873 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-288b3bc7-0de8-4d2c-8649-b1dbbadc1506 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1717 microversion: 2.1 time: 0.209618 May 26 16:58:11.688884 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 301/582] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:11 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1717 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:11.882853 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a2da352b-601b-4204-bd08-e5ddf4ff2859 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:11.884052 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a2da352b-601b-4204-bd08-e5ddf4ff2859 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:11.888810 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ce52eb06-bfdb-469b-a4d3-f5fa5e3da794 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:11.889447 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ce52eb06-bfdb-469b-a4d3-f5fa5e3da794 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:11.897086 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a2da352b-601b-4204-bd08-e5ddf4ff2859 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:11.897586 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ce52eb06-bfdb-469b-a4d3-f5fa5e3da794 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:11.897854 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a2da352b-601b-4204-bd08-e5ddf4ff2859 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:11.898238 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ce52eb06-bfdb-469b-a4d3-f5fa5e3da794 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:11.899178 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ce52eb06-bfdb-469b-a4d3-f5fa5e3da794 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:11.899472 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a2da352b-601b-4204-bd08-e5ddf4ff2859 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:11.899903 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ce52eb06-bfdb-469b-a4d3-f5fa5e3da794 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:11.900400 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a2da352b-601b-4204-bd08-e5ddf4ff2859 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:12.067192 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-ce52eb06-bfdb-469b-a4d3-f5fa5e3da794 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] HTTP exception thrown: Cannot 'detach_volume' instance 8efc5100-c116-4608-a1d9-26e418e0609e while it is in vm_state rescued May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ce52eb06-bfdb-469b-a4d3-f5fa5e3da794 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Request method failure captured: May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: DELETE /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-volume_attachments/485580ff-a759-4eba-a022-fb9d4043a653 HTTP/1.1 May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7CH0rRgnMIlqD063iAZ1ez0QCmlEZqp8QO5ZHjV6XSABZyVeCa3_rL4GukWUzmymH9jymZkR9aYr_V2RQaROCLGEkpNcCgSPyMdlFCJNjPh_1Ze5FLmietbK2CJnk7y7SKXRAka654COK9sD96s20UhiFkxqVLsn7TyJAFc87ArqJ8 May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 5150e5b054d34d09a3cb69e35f9c86dd May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1243169788 May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:58:12.069359 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:58:12.071225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5150e5b054d34d09a3cb69e35f9c86dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5150e5b054d34d09a3cb69e35f9c86dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5150e5b054d34d09a3cb69e35f9c86dd", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5150e5b054d34d09a3cb69e35f9c86dd"}]}] May 26 16:58:12.071225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1243169788 May 26 16:58:12.071225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 5150e5b054d34d09a3cb69e35f9c86dd May 26 16:58:12.071225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1243169788 May 26 16:58:12.071225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-ServerRescueNegativeTestJSON-1243169788-project May 26 16:58:12.071225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:58:12.071225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:58:12.071225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 1cf5ba73296e41c4ab58a6a962b578d3 May 26 16:58:12.071225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1243169788-project May 26 16:58:12.071225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 16:58:12.071225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Cannot 'detach_volume' instance 8efc5100-c116-4608-a1d9-26e418e0609e while it is in vm_state rescued May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'server_id': '8efc5100-c116-4608-a1d9-26e418e0609e', 'id': '485580ff-a759-4eba-a022-fb9d4043a653'} May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8efc5100-c116-4608-a1d9-26e418e0609e in vm_state rescued. Cannot detach_volume while the instance is in this state. May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:58:12.074075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8efc5100-c116-4608-a1d9-26e418e0609e while it is in vm_state rescued May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8efc5100-c116-4608-a1d9-26e418e0609e while it is in vm_state rescued May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:12.075792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ce52eb06-bfdb-469b-a4d3-f5fa5e3da794 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Returning 409 to user: Cannot 'detach_volume' instance 8efc5100-c116-4608-a1d9-26e418e0609e while it is in vm_state rescued {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:58:12.076939 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ce52eb06-bfdb-469b-a4d3-f5fa5e3da794 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-volume_attachments/485580ff-a759-4eba-a022-fb9d4043a653" status: 409 len: 152 microversion: 2.1 time: 0.187316 May 26 16:58:12.076939 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 302/583] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 26 16:58:11 2022] DELETE /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-volume_attachments/485580ff-a759-4eba-a022-fb9d4043a653 => generated 152 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 26 16:58:12.083507 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7282bf7c-b035-4f36-9f63-fb0cb0c7296a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:12.084058 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7282bf7c-b035-4f36-9f63-fb0cb0c7296a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:12.091687 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7282bf7c-b035-4f36-9f63-fb0cb0c7296a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:12.092139 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7282bf7c-b035-4f36-9f63-fb0cb0c7296a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:12.092965 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7282bf7c-b035-4f36-9f63-fb0cb0c7296a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:12.093570 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7282bf7c-b035-4f36-9f63-fb0cb0c7296a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:12.139168 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:12.307252 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a2da352b-601b-4204-bd08-e5ddf4ff2859 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:12.319873 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a2da352b-601b-4204-bd08-e5ddf4ff2859 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1665 microversion: 2.1 time: 0.444987 May 26 16:58:12.321652 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 282/584] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:11 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1665 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:12.403901 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7282bf7c-b035-4f36-9f63-fb0cb0c7296a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "POST /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/action" status: 202 len: 0 microversion: 2.1 time: 0.324657 May 26 16:58:12.404883 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 303/585] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 26 16:58:12 2022] POST /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:58:12.415591 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d0a5f019-14c8-4923-b53c-bb1075b93dc0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:12.417318 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d0a5f019-14c8-4923-b53c-bb1075b93dc0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:12.428166 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0a5f019-14c8-4923-b53c-bb1075b93dc0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:12.428815 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0a5f019-14c8-4923-b53c-bb1075b93dc0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:12.429827 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0a5f019-14c8-4923-b53c-bb1075b93dc0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:12.430347 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0a5f019-14c8-4923-b53c-bb1075b93dc0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:12.667450 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d0a5f019-14c8-4923-b53c-bb1075b93dc0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:12.680062 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d0a5f019-14c8-4923-b53c-bb1075b93dc0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1725 microversion: 2.1 time: 0.270319 May 26 16:58:12.681245 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 283/586] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:12 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1725 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:13.699379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e5f10428-f457-44d1-859a-419cf79ed9f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:13.700394 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e5f10428-f457-44d1-859a-419cf79ed9f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:13.708409 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5f10428-f457-44d1-859a-419cf79ed9f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.708969 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5f10428-f457-44d1-859a-419cf79ed9f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:13.710235 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5f10428-f457-44d1-859a-419cf79ed9f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:13.710684 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5f10428-f457-44d1-859a-419cf79ed9f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:13.884085 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e5f10428-f457-44d1-859a-419cf79ed9f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:13.892616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e5f10428-f457-44d1-859a-419cf79ed9f9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1725 microversion: 2.1 time: 0.197975 May 26 16:58:13.893185 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 304/587] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:13 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:14.911477 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e1fae75a-4623-427a-bfcb-0ba56aa90b2a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:14.912189 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e1fae75a-4623-427a-bfcb-0ba56aa90b2a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:14.934783 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1fae75a-4623-427a-bfcb-0ba56aa90b2a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:14.936011 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1fae75a-4623-427a-bfcb-0ba56aa90b2a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:14.937968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1fae75a-4623-427a-bfcb-0ba56aa90b2a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:14.939444 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1fae75a-4623-427a-bfcb-0ba56aa90b2a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:15.252729 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e1fae75a-4623-427a-bfcb-0ba56aa90b2a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:15.262098 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e1fae75a-4623-427a-bfcb-0ba56aa90b2a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1725 microversion: 2.1 time: 0.354918 May 26 16:58:15.262706 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 284/588] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:14 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1725 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:16.280274 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f6dba8f6-4a21-4129-bae5-3ee5ed2124e9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:16.286058 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f6dba8f6-4a21-4129-bae5-3ee5ed2124e9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:16.290291 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f6dba8f6-4a21-4129-bae5-3ee5ed2124e9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:16.291068 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f6dba8f6-4a21-4129-bae5-3ee5ed2124e9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:16.292197 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f6dba8f6-4a21-4129-bae5-3ee5ed2124e9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:16.292960 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f6dba8f6-4a21-4129-bae5-3ee5ed2124e9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:16.581591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f6dba8f6-4a21-4129-bae5-3ee5ed2124e9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:16.595368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f6dba8f6-4a21-4129-bae5-3ee5ed2124e9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1725 microversion: 2.1 time: 0.318623 May 26 16:58:16.596117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 305/589] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:16 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1725 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:17.614224 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1c81d0df-f539-4452-bd3d-5f283e70e0ee tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:17.614847 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1c81d0df-f539-4452-bd3d-5f283e70e0ee tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:17.622617 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1c81d0df-f539-4452-bd3d-5f283e70e0ee tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:17.624373 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1c81d0df-f539-4452-bd3d-5f283e70e0ee tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:17.624706 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1c81d0df-f539-4452-bd3d-5f283e70e0ee tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:17.625170 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1c81d0df-f539-4452-bd3d-5f283e70e0ee tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:17.790737 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1c81d0df-f539-4452-bd3d-5f283e70e0ee tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:17.799502 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1c81d0df-f539-4452-bd3d-5f283e70e0ee tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1731 microversion: 2.1 time: 0.189446 May 26 16:58:17.800093 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 285/590] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:17 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:17.816592 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9dde950c-ba29-4097-a072-e41d87c2fbdb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:17.817349 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9dde950c-ba29-4097-a072-e41d87c2fbdb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:17.825441 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dde950c-ba29-4097-a072-e41d87c2fbdb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:17.826015 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dde950c-ba29-4097-a072-e41d87c2fbdb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:17.826917 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dde950c-ba29-4097-a072-e41d87c2fbdb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:17.827422 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dde950c-ba29-4097-a072-e41d87c2fbdb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:18.192621 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9dde950c-ba29-4097-a072-e41d87c2fbdb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.380144 May 26 16:58:18.193214 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 306/591] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 26 16:58:17 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-interface => generated 285 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:19.371065 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-0fedae87-ee26-492e-aac6-fcf474b0b574 req-773bae0f-d1b2-47cb-adfe-7fda1be6fac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8efc5100-c116-4608-a1d9-26e418e0609e", "tag": "3477b3a3-f453-4aca-9e4e-a3d0795c1473"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:19.380135 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-0fedae87-ee26-492e-aac6-fcf474b0b574 req-773bae0f-d1b2-47cb-adfe-7fda1be6fac3 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:19.380925 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-0fedae87-ee26-492e-aac6-fcf474b0b574 req-773bae0f-d1b2-47cb-adfe-7fda1be6fac3 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:19.398129 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-0fedae87-ee26-492e-aac6-fcf474b0b574 req-773bae0f-d1b2-47cb-adfe-7fda1be6fac3 service nova] Creating event network-changed:3477b3a3-f453-4aca-9e4e-a3d0795c1473 for instance 8efc5100-c116-4608-a1d9-26e418e0609e on hv-cinder-83607 May 26 16:58:19.404431 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-0fedae87-ee26-492e-aac6-fcf474b0b574 req-773bae0f-d1b2-47cb-adfe-7fda1be6fac3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037660 May 26 16:58:19.405929 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 286/592] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:21.443193 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-45e3b06b-fab7-480e-b5d8-a9d138d4a3e4 req-6a9bb725-1b6e-40bb-88ba-3f71a2798170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8efc5100-c116-4608-a1d9-26e418e0609e", "tag": "3477b3a3-f453-4aca-9e4e-a3d0795c1473"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:21.451689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-45e3b06b-fab7-480e-b5d8-a9d138d4a3e4 req-6a9bb725-1b6e-40bb-88ba-3f71a2798170 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:21.452436 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-45e3b06b-fab7-480e-b5d8-a9d138d4a3e4 req-6a9bb725-1b6e-40bb-88ba-3f71a2798170 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:21.464839 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-45e3b06b-fab7-480e-b5d8-a9d138d4a3e4 req-6a9bb725-1b6e-40bb-88ba-3f71a2798170 service nova] Creating event network-changed:3477b3a3-f453-4aca-9e4e-a3d0795c1473 for instance 8efc5100-c116-4608-a1d9-26e418e0609e on hv-cinder-83607 May 26 16:58:21.473053 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-45e3b06b-fab7-480e-b5d8-a9d138d4a3e4 req-6a9bb725-1b6e-40bb-88ba-3f71a2798170 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037347 May 26 16:58:21.474167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 307/593] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:22.286061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-936b8d48-1b92-4db4-b3d0-6a4be663c14e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:22.287186 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-936b8d48-1b92-4db4-b3d0-6a4be663c14e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:22.295073 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-936b8d48-1b92-4db4-b3d0-6a4be663c14e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.295889 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-936b8d48-1b92-4db4-b3d0-6a4be663c14e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.296898 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-936b8d48-1b92-4db4-b3d0-6a4be663c14e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.297464 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-936b8d48-1b92-4db4-b3d0-6a4be663c14e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.323779 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-936b8d48-1b92-4db4-b3d0-6a4be663c14e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e/ips" status: 200 len: 151 microversion: 2.1 time: 0.042174 May 26 16:58:22.330427 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 287/594] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 26 16:58:22 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:22.335493 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-de8bba75-839c-4b25-bbc9-c1afa0e53611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c16c3971-32b8-4acb-9946-b4202c4adc6d"}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:22.336700 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-de8bba75-839c-4b25-bbc9-c1afa0e53611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:22.345496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=48 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:22.347726 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-de8bba75-839c-4b25-bbc9-c1afa0e53611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.348456 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-de8bba75-839c-4b25-bbc9-c1afa0e53611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.349248 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-de8bba75-839c-4b25-bbc9-c1afa0e53611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.351888 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-de8bba75-839c-4b25-bbc9-c1afa0e53611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.470251 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-de8bba75-839c-4b25-bbc9-c1afa0e53611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] HTTP exception thrown: Invalid volume: volume c16c3971-32b8-4acb-9946-b4202c4adc6d is already attached to instances: 922fbe1c-0632-41ec-b652-d4e1c457d234 May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-de8bba75-839c-4b25-bbc9-c1afa0e53611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Request method failure captured: May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: POST /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e/os-volume_attachments HTTP/1.1 May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 74 May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7DzbhltvfRlN11wtcZ5l_X_WvcTEIigXlOrGIiq9Yx6XlBxWNmzLmNABRCmLnPTr4rRVR4UaIBjMcSZhnziOK1SfjgVmtsWHcVwpG_z7xB0-B1QZy0o_2qrsjZYhxYRjwS8MjkCFlKcl1g60M7fXrlp400fuazE8HitBHbMDtgjELA May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:58:22.472519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:58:22.474445 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_060af6cf4f7a48758f6859bd3766ae1b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/060af6cf4f7a48758f6859bd3766ae1b"}]}] May 26 16:58:22.474445 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeNegativeTest-1609360552 May 26 16:58:22.474445 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 16:58:22.474445 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 16:58:22.474445 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeNegativeTest-1609360552-project May 26 16:58:22.474445 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:58:22.474445 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:58:22.474445 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 1551f28754a64d1d9010ed90b67c5dc4 May 26 16:58:22.474445 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeNegativeTest-1609360552-project May 26 16:58:22.474445 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: May 26 16:58:22.474445 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {"volumeAttachment": {"volumeId": "c16c3971-32b8-4acb-9946-b4202c4adc6d"}} May 26 16:58:22.474445 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Invalid volume: volume c16c3971-32b8-4acb-9946-b4202c4adc6d is already attached to instances: 922fbe1c-0632-41ec-b652-d4e1c457d234 May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'server_id': '550e0ebe-517e-452c-97bf-ac35669bab9e', 'body': {'volumeAttachment': {'volumeId': 'c16c3971-32b8-4acb-9946-b4202c4adc6d'}}} May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c16c3971-32b8-4acb-9946-b4202c4adc6d is already attached to instances: 922fbe1c-0632-41ec-b652-d4e1c457d234 May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:22.475420 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c16c3971-32b8-4acb-9946-b4202c4adc6d is already attached to instances: 922fbe1c-0632-41ec-b652-d4e1c457d234 May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:22.476833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:22.478259 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:22.478259 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:58:22.478259 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:58:22.478259 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c16c3971-32b8-4acb-9946-b4202c4adc6d is already attached to instances: 922fbe1c-0632-41ec-b652-d4e1c457d234 May 26 16:58:22.478259 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:22.480153 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-de8bba75-839c-4b25-bbc9-c1afa0e53611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Returning 400 to user: Invalid volume: volume c16c3971-32b8-4acb-9946-b4202c4adc6d is already attached to instances: 922fbe1c-0632-41ec-b652-d4e1c457d234 {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:58:22.481429 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-de8bba75-839c-4b25-bbc9-c1afa0e53611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "POST /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.150466 May 26 16:58:22.485404 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 308/595] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 26 16:58:22 2022] POST /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e/os-volume_attachments => generated 174 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 16:58:22.491908 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-174b2a0f-369d-4c6b-a422-410a6221b179 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:22.492785 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-174b2a0f-369d-4c6b-a422-410a6221b179 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:22.499899 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-174b2a0f-369d-4c6b-a422-410a6221b179 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.500411 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-174b2a0f-369d-4c6b-a422-410a6221b179 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.501238 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-174b2a0f-369d-4c6b-a422-410a6221b179 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.501709 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-174b2a0f-369d-4c6b-a422-410a6221b179 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.530011 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-174b2a0f-369d-4c6b-a422-410a6221b179 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:58:22.959773 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-174b2a0f-369d-4c6b-a422-410a6221b179 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "DELETE /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 204 len: 0 microversion: 2.1 time: 0.471668 May 26 16:58:22.960920 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 288/596] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 16:58:22 2022] DELETE /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 16:58:22.970148 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-d2d6c1d0-8c02-4b9f-90c1-b0afe74c26c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:22.971029 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-d2d6c1d0-8c02-4b9f-90c1-b0afe74c26c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:22.982737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d2d6c1d0-8c02-4b9f-90c1-b0afe74c26c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.983585 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d2d6c1d0-8c02-4b9f-90c1-b0afe74c26c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:22.985511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d2d6c1d0-8c02-4b9f-90c1-b0afe74c26c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:22.986260 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d2d6c1d0-8c02-4b9f-90c1-b0afe74c26c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:23.181292 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d2d6c1d0-8c02-4b9f-90c1-b0afe74c26c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:23.189475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-d2d6c1d0-8c02-4b9f-90c1-b0afe74c26c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1683 microversion: 2.1 time: 0.224056 May 26 16:58:23.190087 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 309/597] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:22 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1683 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:24.213210 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-74b04595-09c4-43af-86f1-4c2f25e25e83 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:24.214347 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-74b04595-09c4-43af-86f1-4c2f25e25e83 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:24.215284 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2810a9b8-e4e8-4fba-b844-1394d2d6231c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Action: 'create', calling method: .version_select at 0x7fbe803c51f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1495379482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUBIxbHcOljKwJEJjhjWSAr9lj5ER+HvueWZR4cAa7QzBKZ5pEIiqUQPQFKAwFVeptgCBa2dLahD1b/m2UgFJ1fzPXoty2JEjSghvQAjAzTFRwJht9QExzVmlRB9heBhQ=="}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:24.227166 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-74b04595-09c4-43af-86f1-4c2f25e25e83 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:24.231671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-74b04595-09c4-43af-86f1-4c2f25e25e83 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:24.231671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-74b04595-09c4-43af-86f1-4c2f25e25e83 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:24.231671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-74b04595-09c4-43af-86f1-4c2f25e25e83 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:24.234152 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-2810a9b8-e4e8-4fba-b844-1394d2d6231c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Getting quotas for project b9562e9c747f4808a67c01436d9ede47. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:58:24.239107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-2810a9b8-e4e8-4fba-b844-1394d2d6231c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Getting quotas for user 4e68c10e83634018b70ca664e1e8f08c and project b9562e9c747f4808a67c01436d9ede47. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:58:24.319621 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2810a9b8-e4e8-4fba-b844-1394d2d6231c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.262797 May 26 16:58:24.320151 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 289/598] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 26 16:58:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:24.403117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-74b04595-09c4-43af-86f1-4c2f25e25e83 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:24.414247 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-74b04595-09c4-43af-86f1-4c2f25e25e83 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1683 microversion: 2.1 time: 0.208593 May 26 16:58:24.415156 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 310/599] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:24 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1683 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:25.431619 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bf26a66d-23e6-4846-8198-d7f376021611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:25.432596 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bf26a66d-23e6-4846-8198-d7f376021611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:25.442468 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf26a66d-23e6-4846-8198-d7f376021611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:25.442920 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf26a66d-23e6-4846-8198-d7f376021611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:25.443700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf26a66d-23e6-4846-8198-d7f376021611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:25.444141 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf26a66d-23e6-4846-8198-d7f376021611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:25.665646 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bf26a66d-23e6-4846-8198-d7f376021611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:25.673627 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bf26a66d-23e6-4846-8198-d7f376021611 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1683 microversion: 2.1 time: 0.245909 May 26 16:58:25.676958 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 290/600] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:25 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1683 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:26.349601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-2ef797ab-48fa-4df3-aaff-6aaa132b4a9a req-c0d67a2e-e90a-4ed1-99f3-4f65a9ba564d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "550e0ebe-517e-452c-97bf-ac35669bab9e", "name": "network-vif-deleted", "tag": "d95376b4-838e-489b-8c7d-892435fd9f18"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:26.359058 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-2ef797ab-48fa-4df3-aaff-6aaa132b4a9a req-c0d67a2e-e90a-4ed1-99f3-4f65a9ba564d service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:26.359706 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-2ef797ab-48fa-4df3-aaff-6aaa132b4a9a req-c0d67a2e-e90a-4ed1-99f3-4f65a9ba564d service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:26.372058 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-2ef797ab-48fa-4df3-aaff-6aaa132b4a9a req-c0d67a2e-e90a-4ed1-99f3-4f65a9ba564d service nova] Creating event network-vif-deleted:d95376b4-838e-489b-8c7d-892435fd9f18 for instance 550e0ebe-517e-452c-97bf-ac35669bab9e on hv-cinder-83607 May 26 16:58:26.377054 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-2ef797ab-48fa-4df3-aaff-6aaa132b4a9a req-c0d67a2e-e90a-4ed1-99f3-4f65a9ba564d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031930 May 26 16:58:26.377697 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 311/601] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:26.692569 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d543c58e-67af-4421-9f2c-29a3baa5235b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:26.693237 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d543c58e-67af-4421-9f2c-29a3baa5235b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:26.700526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d543c58e-67af-4421-9f2c-29a3baa5235b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:26.700982 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d543c58e-67af-4421-9f2c-29a3baa5235b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:26.701967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d543c58e-67af-4421-9f2c-29a3baa5235b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:26.702367 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d543c58e-67af-4421-9f2c-29a3baa5235b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:26.798791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d543c58e-67af-4421-9f2c-29a3baa5235b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:26.817340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d543c58e-67af-4421-9f2c-29a3baa5235b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 200 len: 1326 microversion: 2.1 time: 0.129694 May 26 16:58:26.820081 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 291/602] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:26 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 1326 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:27.843685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8df6e93e-e8a3-4d82-ae6d-d6f6bcf0cf3c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:27.844489 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8df6e93e-e8a3-4d82-ae6d-d6f6bcf0cf3c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:27.852467 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8df6e93e-e8a3-4d82-ae6d-d6f6bcf0cf3c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:27.855893 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8df6e93e-e8a3-4d82-ae6d-d6f6bcf0cf3c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:27.855893 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8df6e93e-e8a3-4d82-ae6d-d6f6bcf0cf3c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:27.855893 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8df6e93e-e8a3-4d82-ae6d-d6f6bcf0cf3c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:27.869965 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-8df6e93e-e8a3-4d82-ae6d-d6f6bcf0cf3c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] HTTP exception thrown: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8df6e93e-e8a3-4d82-ae6d-d6f6bcf0cf3c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Request method failure captured: May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e HTTP/1.1 May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7DzbhltvfRlN11wtcZ5l_X_WvcTEIigXlOrGIiq9Yx6XlBxWNmzLmNABRCmLnPTr4rRVR4UaIBjMcSZhnziOK1SfjgVmtsWHcVwpG_z7xB0-B1QZy0o_2qrsjZYhxYRjwS8MjkCFlKcl1g60M7fXrlp400fuazE8HitBHbMDtgjELA May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:58:27.871634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:58:27.873074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_060af6cf4f7a48758f6859bd3766ae1b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/060af6cf4f7a48758f6859bd3766ae1b"}]}] May 26 16:58:27.873074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeNegativeTest-1609360552 May 26 16:58:27.873074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 16:58:27.873074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 16:58:27.873074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeNegativeTest-1609360552-project May 26 16:58:27.873074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:58:27.873074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:58:27.873074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 1551f28754a64d1d9010ed90b67c5dc4 May 26 16:58:27.873074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeNegativeTest-1609360552-project May 26 16:58:27.873074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 16:58:27.873074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. May 26 16:58:27.873074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '550e0ebe-517e-452c-97bf-ac35669bab9e'} May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:58:27.873977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. May 26 16:58:27.875306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:27.877394 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8df6e93e-e8a3-4d82-ae6d-d6f6bcf0cf3c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Returning 404 to user: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:58:27.877394 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8df6e93e-e8a3-4d82-ae6d-d6f6bcf0cf3c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 404 len: 111 microversion: 2.1 time: 0.039826 May 26 16:58:27.882645 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b9e4b50e-3c2f-4c20-9e93-a55a564c8862 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '.version_select at 0x7fbe80573940>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:27.889579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 312/603] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:27 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:58:27.993812 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b9e4b50e-3c2f-4c20-9e93-a55a564c8862 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-906685521" status: 202 len: 0 microversion: 2.1 time: 0.114619 May 26 16:58:27.995780 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 292/604] 10.222.0.48 () {58 vars in 1217 bytes} [Thu May 26 16:58:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-906685521 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:58:29.146267 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f457d1cd-0f0f-4c23-99d8-69fe9898b75e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:29.147323 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f457d1cd-0f0f-4c23-99d8-69fe9898b75e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:29.155589 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f457d1cd-0f0f-4c23-99d8-69fe9898b75e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:29.156255 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f457d1cd-0f0f-4c23-99d8-69fe9898b75e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:29.157206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f457d1cd-0f0f-4c23-99d8-69fe9898b75e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:29.157828 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f457d1cd-0f0f-4c23-99d8-69fe9898b75e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:29.333594 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-f457d1cd-0f0f-4c23-99d8-69fe9898b75e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lazy-loading 'services' on Instance uuid 922fbe1c-0632-41ec-b652-d4e1c457d234 {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:58:29.603835 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f457d1cd-0f0f-4c23-99d8-69fe9898b75e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "DELETE /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234/os-volume_attachments/c16c3971-32b8-4acb-9946-b4202c4adc6d" status: 202 len: 0 microversion: 2.1 time: 0.461361 May 26 16:58:29.604692 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 313/605] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 26 16:58:29 2022] DELETE /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234/os-volume_attachments/c16c3971-32b8-4acb-9946-b4202c4adc6d => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:58:29.615298 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4707e5e6-785a-483c-924b-95171d40d8a8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:29.616936 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4707e5e6-785a-483c-924b-95171d40d8a8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:29.619326 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:29.625670 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4707e5e6-785a-483c-924b-95171d40d8a8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:29.626185 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4707e5e6-785a-483c-924b-95171d40d8a8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:29.626991 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4707e5e6-785a-483c-924b-95171d40d8a8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:29.627433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4707e5e6-785a-483c-924b-95171d40d8a8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:29.664057 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4707e5e6-785a-483c-924b-95171d40d8a8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054034 May 26 16:58:29.671241 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 293/606] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 16:58:29 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:30.685377 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ff12e883-7612-4b13-9512-ea324fae298c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:30.686331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ff12e883-7612-4b13-9512-ea324fae298c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:30.694384 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ff12e883-7612-4b13-9512-ea324fae298c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:30.694843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ff12e883-7612-4b13-9512-ea324fae298c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:30.695635 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ff12e883-7612-4b13-9512-ea324fae298c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:30.696076 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ff12e883-7612-4b13-9512-ea324fae298c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:30.731162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ff12e883-7612-4b13-9512-ea324fae298c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050397 May 26 16:58:30.731820 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 314/607] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 16:58:30 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:31.745829 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3b8a1cf5-b4e5-4b8d-a12c-60105ce726af tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:31.747195 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3b8a1cf5-b4e5-4b8d-a12c-60105ce726af tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:31.755326 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b8a1cf5-b4e5-4b8d-a12c-60105ce726af tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:31.755633 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b8a1cf5-b4e5-4b8d-a12c-60105ce726af tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:31.756485 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b8a1cf5-b4e5-4b8d-a12c-60105ce726af tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:31.756964 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b8a1cf5-b4e5-4b8d-a12c-60105ce726af tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:31.783519 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:31.790505 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3b8a1cf5-b4e5-4b8d-a12c-60105ce726af tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049735 May 26 16:58:31.791088 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 294/608] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 16:58:31 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 16:58:31.866930 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7c905c52-75eb-45a7-979e-066883b376a7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:31.867492 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7c905c52-75eb-45a7-979e-066883b376a7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:31.875006 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7c905c52-75eb-45a7-979e-066883b376a7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:31.875451 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7c905c52-75eb-45a7-979e-066883b376a7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:31.876233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7c905c52-75eb-45a7-979e-066883b376a7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:31.876670 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7c905c52-75eb-45a7-979e-066883b376a7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:31.904882 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7c905c52-75eb-45a7-979e-066883b376a7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Going to try to terminate instance {{(pid=124836) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:58:32.409083 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7c905c52-75eb-45a7-979e-066883b376a7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "DELETE /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 204 len: 0 microversion: 2.1 time: 0.546507 May 26 16:58:32.409706 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 315/609] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 16:58:31 2022] DELETE /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:58:32.418377 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f0dcfd87-85f5-4ff3-afee-f0dc42172c2b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:32.419042 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f0dcfd87-85f5-4ff3-afee-f0dc42172c2b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:32.428414 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f0dcfd87-85f5-4ff3-afee-f0dc42172c2b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:32.431778 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f0dcfd87-85f5-4ff3-afee-f0dc42172c2b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:32.431778 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f0dcfd87-85f5-4ff3-afee-f0dc42172c2b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:32.431778 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f0dcfd87-85f5-4ff3-afee-f0dc42172c2b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:32.573369 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f0dcfd87-85f5-4ff3-afee-f0dc42172c2b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:32.581394 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f0dcfd87-85f5-4ff3-afee-f0dc42172c2b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1681 microversion: 2.1 time: 0.167193 May 26 16:58:32.581986 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 295/610] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:32 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:33.600943 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3292cbf5-3750-46ab-9bb6-5a15fce460cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:33.601786 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3292cbf5-3750-46ab-9bb6-5a15fce460cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:33.608825 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3292cbf5-3750-46ab-9bb6-5a15fce460cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:33.609311 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3292cbf5-3750-46ab-9bb6-5a15fce460cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:33.610091 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3292cbf5-3750-46ab-9bb6-5a15fce460cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:33.610536 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3292cbf5-3750-46ab-9bb6-5a15fce460cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:33.750452 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3292cbf5-3750-46ab-9bb6-5a15fce460cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:33.760636 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3292cbf5-3750-46ab-9bb6-5a15fce460cf tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1681 microversion: 2.1 time: 0.164686 May 26 16:58:33.761394 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 316/611] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:33 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:34.777913 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-42a1328b-9b83-4371-8c5e-0f9d7d500f3d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:34.778671 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-42a1328b-9b83-4371-8c5e-0f9d7d500f3d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:34.781389 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=4 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:34.787397 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42a1328b-9b83-4371-8c5e-0f9d7d500f3d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:34.787850 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42a1328b-9b83-4371-8c5e-0f9d7d500f3d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.788653 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42a1328b-9b83-4371-8c5e-0f9d7d500f3d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:34.789168 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42a1328b-9b83-4371-8c5e-0f9d7d500f3d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:34.923991 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-42a1328b-9b83-4371-8c5e-0f9d7d500f3d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:34.936020 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-42a1328b-9b83-4371-8c5e-0f9d7d500f3d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1681 microversion: 2.1 time: 0.158092 May 26 16:58:34.936020 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 296/612] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:34 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:35.729611 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-0406577b-7a1e-48fa-b9a1-bd95a93d61ae req-d8962b39-6bcb-4bfd-9e62-1e67c40db0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922fbe1c-0632-41ec-b652-d4e1c457d234", "name": "network-vif-deleted", "tag": "aa42d105-247d-49cd-9b56-b9f75a4b66eb"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:35.738638 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-0406577b-7a1e-48fa-b9a1-bd95a93d61ae req-d8962b39-6bcb-4bfd-9e62-1e67c40db0a3 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:35.744518 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-0406577b-7a1e-48fa-b9a1-bd95a93d61ae req-d8962b39-6bcb-4bfd-9e62-1e67c40db0a3 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:35.751355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-0406577b-7a1e-48fa-b9a1-bd95a93d61ae req-d8962b39-6bcb-4bfd-9e62-1e67c40db0a3 service nova] Creating event network-vif-deleted:aa42d105-247d-49cd-9b56-b9f75a4b66eb for instance 922fbe1c-0632-41ec-b652-d4e1c457d234 on hv-cinder-83607 May 26 16:58:35.756874 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-0406577b-7a1e-48fa-b9a1-bd95a93d61ae req-d8962b39-6bcb-4bfd-9e62-1e67c40db0a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031789 May 26 16:58:35.757533 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 317/613] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:35.949064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4dacbf99-bef5-444b-b416-23ea6a679dc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:35.949841 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4dacbf99-bef5-444b-b416-23ea6a679dc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:35.957946 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4dacbf99-bef5-444b-b416-23ea6a679dc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:35.958672 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4dacbf99-bef5-444b-b416-23ea6a679dc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:35.959676 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4dacbf99-bef5-444b-b416-23ea6a679dc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:35.960286 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4dacbf99-bef5-444b-b416-23ea6a679dc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:36.030362 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4dacbf99-bef5-444b-b416-23ea6a679dc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:36.038362 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4dacbf99-bef5-444b-b416-23ea6a679dc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1325 microversion: 2.1 time: 0.093266 May 26 16:58:36.047641 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 297/614] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:35 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1325 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:37.026891 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-17bd4ae7-8d9f-44a2-a7ca-f6fdce8f77b3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:37.027474 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-17bd4ae7-8d9f-44a2-a7ca-f6fdce8f77b3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:37.034440 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-17bd4ae7-8d9f-44a2-a7ca-f6fdce8f77b3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:37.034908 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-17bd4ae7-8d9f-44a2-a7ca-f6fdce8f77b3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.035674 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-17bd4ae7-8d9f-44a2-a7ca-f6fdce8f77b3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:37.036116 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-17bd4ae7-8d9f-44a2-a7ca-f6fdce8f77b3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.055831 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e9a5eb79-557e-4356-8bcc-9ee51ca0adad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:37.057129 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e9a5eb79-557e-4356-8bcc-9ee51ca0adad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:37.065413 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e9a5eb79-557e-4356-8bcc-9ee51ca0adad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:37.065871 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e9a5eb79-557e-4356-8bcc-9ee51ca0adad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.066833 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e9a5eb79-557e-4356-8bcc-9ee51ca0adad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:37.067276 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e9a5eb79-557e-4356-8bcc-9ee51ca0adad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.081488 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-17bd4ae7-8d9f-44a2-a7ca-f6fdce8f77b3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/os-volume_attachments/d0492a8e-40a9-4235-89ec-dc5699dd71d2" status: 200 len: 194 microversion: 2.20 time: 0.174787 May 26 16:58:37.082408 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 318/615] 10.222.0.48 () {60 vars in 1453 bytes} [Thu May 26 16:58:36 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/os-volume_attachments/d0492a8e-40a9-4235-89ec-dc5699dd71d2 => generated 194 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:58:37.106211 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e9a5eb79-557e-4356-8bcc-9ee51ca0adad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:37.106754 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e9a5eb79-557e-4356-8bcc-9ee51ca0adad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.107290 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-e9a5eb79-557e-4356-8bcc-9ee51ca0adad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lazy-loading 'fault' on Instance uuid 922fbe1c-0632-41ec-b652-d4e1c457d234 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:58:37.157640 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3fd4e8ce-2dca-4909-9206-4d1ade1d8bc5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:37.158511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3fd4e8ce-2dca-4909-9206-4d1ade1d8bc5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:37.164576 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e9a5eb79-557e-4356-8bcc-9ee51ca0adad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:37.166326 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3fd4e8ce-2dca-4909-9206-4d1ade1d8bc5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:37.166862 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3fd4e8ce-2dca-4909-9206-4d1ade1d8bc5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.167851 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3fd4e8ce-2dca-4909-9206-4d1ade1d8bc5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:37.168819 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3fd4e8ce-2dca-4909-9206-4d1ade1d8bc5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.173142 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e9a5eb79-557e-4356-8bcc-9ee51ca0adad tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 200 len: 1330 microversion: 2.1 time: 0.121116 May 26 16:58:37.173868 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 298/616] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:37 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 1330 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:37.255071 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-3fd4e8ce-2dca-4909-9206-4d1ade1d8bc5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lazy-loading 'services' on Instance uuid d0daf7ae-8eab-479b-b4cb-380a68f5bfaa {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:58:37.441699 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:37.512025 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3fd4e8ce-2dca-4909-9206-4d1ade1d8bc5 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/os-volume_attachments/d0492a8e-40a9-4235-89ec-dc5699dd71d2" status: 202 len: 0 microversion: 2.20 time: 0.358955 May 26 16:58:37.512611 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 319/617] 10.222.0.48 () {60 vars in 1456 bytes} [Thu May 26 16:58:37 2022] DELETE /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/os-volume_attachments/d0492a8e-40a9-4235-89ec-dc5699dd71d2 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 16:58:37.522989 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4c0b7160-b745-433a-a8a1-6bcd2550e2d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:37.526682 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4c0b7160-b745-433a-a8a1-6bcd2550e2d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:37.538315 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c0b7160-b745-433a-a8a1-6bcd2550e2d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:37.539137 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c0b7160-b745-433a-a8a1-6bcd2550e2d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.540531 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c0b7160-b745-433a-a8a1-6bcd2550e2d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:37.541352 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4c0b7160-b745-433a-a8a1-6bcd2550e2d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:37.574590 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4c0b7160-b745-433a-a8a1-6bcd2550e2d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057266 May 26 16:58:37.575163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 299/618] 10.222.0.48 () {60 vars in 1342 bytes} [Thu May 26 16:58:37 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:58:38.198488 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-856b2c0c-40f5-4d98-a16d-cdfacde699f2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:38.199221 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-856b2c0c-40f5-4d98-a16d-cdfacde699f2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:38.206897 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-856b2c0c-40f5-4d98-a16d-cdfacde699f2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:38.207333 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-856b2c0c-40f5-4d98-a16d-cdfacde699f2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:38.208121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-856b2c0c-40f5-4d98-a16d-cdfacde699f2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:38.208555 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-856b2c0c-40f5-4d98-a16d-cdfacde699f2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:38.225403 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-856b2c0c-40f5-4d98-a16d-cdfacde699f2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] HTTP exception thrown: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-856b2c0c-40f5-4d98-a16d-cdfacde699f2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Request method failure captured: May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 HTTP/1.1 May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7DzbhltvfRlN11wtcZ5l_X_WvcTEIigXlOrGIiq9Yx6XlBxWNmzLmNABRCmLnPTr4rRVR4UaIBjMcSZhnziOK1SfjgVmtsWHcVwpG_z7xB0-B1QZy0o_2qrsjZYhxYRjwS8MjkCFlKcl1g60M7fXrlp400fuazE8HitBHbMDtgjELA May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:58:38.227041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:58:38.228632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_060af6cf4f7a48758f6859bd3766ae1b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/060af6cf4f7a48758f6859bd3766ae1b"}]}] May 26 16:58:38.228632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeNegativeTest-1609360552 May 26 16:58:38.228632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 16:58:38.228632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 16:58:38.228632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeNegativeTest-1609360552-project May 26 16:58:38.228632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:58:38.228632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:58:38.228632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 1551f28754a64d1d9010ed90b67c5dc4 May 26 16:58:38.228632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeNegativeTest-1609360552-project May 26 16:58:38.228632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 16:58:38.228632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. May 26 16:58:38.228632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '922fbe1c-0632-41ec-b652-d4e1c457d234'} May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:58:38.229685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. May 26 16:58:38.231078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:58:38.232350 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-856b2c0c-40f5-4d98-a16d-cdfacde699f2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Returning 404 to user: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:58:38.232350 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-856b2c0c-40f5-4d98-a16d-cdfacde699f2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 404 len: 111 microversion: 2.1 time: 0.035788 May 26 16:58:38.232350 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 320/619] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:38 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:58:38.238849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a092b4d8-c41f-4620-955c-7b714b0df2f8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '.version_select at 0x7fbe803c5280>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:38.306980 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a092b4d8-c41f-4620-955c-7b714b0df2f8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-34356173" status: 202 len: 0 microversion: 2.1 time: 0.072047 May 26 16:58:38.307690 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 300/620] 10.222.0.48 () {58 vars in 1214 bytes} [Thu May 26 16:58:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-34356173 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:58:38.587048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-56b4a21e-83ac-4424-bd06-504b2af2954d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:38.588194 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-56b4a21e-83ac-4424-bd06-504b2af2954d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:38.595400 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-56b4a21e-83ac-4424-bd06-504b2af2954d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:38.595849 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-56b4a21e-83ac-4424-bd06-504b2af2954d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:38.596628 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-56b4a21e-83ac-4424-bd06-504b2af2954d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:38.597069 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-56b4a21e-83ac-4424-bd06-504b2af2954d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:38.633412 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-56b4a21e-83ac-4424-bd06-504b2af2954d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050338 May 26 16:58:38.634524 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 321/621] 10.222.0.48 () {60 vars in 1342 bytes} [Thu May 26 16:58:38 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:58:39.085784 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bde84053-e729-4db5-be4e-7da30e709cdb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Action: 'create', calling method: .version_select at 0x7fbe804b8c10>, body: {"keypair": {"name": "tempest-keypair-1137858594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs206k2uE+hglEiFFnGBDE10o7fuUXhKMAICZf7E5izVWsezQXJgVwEE/MOM7ruBzt+UZcsm4q+pb+7W4+/LxltC8ffhpE71N19OTLKpDr02hI9ywZ0W3JgaENACclEFA=="}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:39.101432 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-bde84053-e729-4db5-be4e-7da30e709cdb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:58:39.105213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-bde84053-e729-4db5-be4e-7da30e709cdb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for user 1551f28754a64d1d9010ed90b67c5dc4 and project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:58:39.204343 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bde84053-e729-4db5-be4e-7da30e709cdb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122960 May 26 16:58:39.204942 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 301/622] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 26 16:58:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:39.647917 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-910857af-6f27-4cfe-bca5-33bfe4fc68b9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:39.648858 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-910857af-6f27-4cfe-bca5-33bfe4fc68b9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:39.656336 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-910857af-6f27-4cfe-bca5-33bfe4fc68b9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:39.656791 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-910857af-6f27-4cfe-bca5-33bfe4fc68b9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:39.657676 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-910857af-6f27-4cfe-bca5-33bfe4fc68b9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:39.658121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-910857af-6f27-4cfe-bca5-33bfe4fc68b9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:39.690776 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-910857af-6f27-4cfe-bca5-33bfe4fc68b9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047839 May 26 16:58:39.691689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 322/623] 10.222.0.48 () {60 vars in 1342 bytes} [Thu May 26 16:58:39 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:39.759514 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-86539e0e-d4e4-4f99-8163-73f793fcedca tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:39.760164 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-86539e0e-d4e4-4f99-8163-73f793fcedca tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:39.766040 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86539e0e-d4e4-4f99-8163-73f793fcedca tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:39.766490 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86539e0e-d4e4-4f99-8163-73f793fcedca tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:39.767255 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86539e0e-d4e4-4f99-8163-73f793fcedca tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:39.767692 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-86539e0e-d4e4-4f99-8163-73f793fcedca tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:39.793991 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-86539e0e-d4e4-4f99-8163-73f793fcedca tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:58:40.239378 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-86539e0e-d4e4-4f99-8163-73f793fcedca tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 204 len: 0 microversion: 2.20 time: 0.483975 May 26 16:58:40.240135 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 302/624] 10.222.0.48 () {60 vars in 1279 bytes} [Thu May 26 16:58:39 2022] DELETE /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 16:58:40.248325 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9262dc1f-bcc0-4462-a83e-d134aea935e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:40.248962 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9262dc1f-bcc0-4462-a83e-d134aea935e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:40.255504 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9262dc1f-bcc0-4462-a83e-d134aea935e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:40.255955 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9262dc1f-bcc0-4462-a83e-d134aea935e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:40.256724 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9262dc1f-bcc0-4462-a83e-d134aea935e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:40.257198 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9262dc1f-bcc0-4462-a83e-d134aea935e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:40.607221 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9262dc1f-bcc0-4462-a83e-d134aea935e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:40.616073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9262dc1f-bcc0-4462-a83e-d134aea935e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:40.617852 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9262dc1f-bcc0-4462-a83e-d134aea935e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:40.619026 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9262dc1f-bcc0-4462-a83e-d134aea935e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.374712 May 26 16:58:40.619581 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 323/625] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:58:40 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:41.638799 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-69850ef2-4ea0-4deb-9360-08c61fc2a455 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:41.639534 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-69850ef2-4ea0-4deb-9360-08c61fc2a455 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:41.646716 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-69850ef2-4ea0-4deb-9360-08c61fc2a455 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:41.647166 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-69850ef2-4ea0-4deb-9360-08c61fc2a455 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:41.647928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-69850ef2-4ea0-4deb-9360-08c61fc2a455 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:41.648369 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-69850ef2-4ea0-4deb-9360-08c61fc2a455 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:41.760401 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1598138341", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f04a253f-94d5-469e-a169-e4789fc9cd70"}], "security_groups": [{"name": "tempest-securitygroup--645638257"}], "key_name": "tempest-keypair-1137858594", "user_data": "}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:41.782706 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-69850ef2-4ea0-4deb-9360-08c61fc2a455 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:41.791819 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-69850ef2-4ea0-4deb-9360-08c61fc2a455 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:41.804223 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-69850ef2-4ea0-4deb-9360-08c61fc2a455 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:41.804223 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-69850ef2-4ea0-4deb-9360-08c61fc2a455 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.160149 May 26 16:58:41.804223 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 303/626] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:58:41 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:41.866128 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.network.neutron [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] validate_networks() for [('f04a253f-94d5-469e-a169-e4789fc9cd70', None, None, None, None, None)] {{(pid=124836) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:58:42.298253 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Flavor limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:58:42.298919 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Image limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:58:42.300108 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Flavor pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:58:42.300530 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Image pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:58:42.300974 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:58:42.310875 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:42.311334 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:42.312143 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:42.312585 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:42.330529 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:58:42.334726 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for user 1551f28754a64d1d9010ed90b67c5dc4 and project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:58:42.346253 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Going to run 1 instances... {{(pid=124836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:58:42.348806 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:58:42.484641 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-871f02ba-cf35-4135-b082-130a2091fa8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.728467 May 26 16:58:42.485230 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 324/627] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 16:58:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 16:58:42.495720 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-714108e5-ecf7-470b-86bf-5a1672ccad1f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:42.496398 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-714108e5-ecf7-470b-86bf-5a1672ccad1f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:42.551786 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-714108e5-ecf7-470b-86bf-5a1672ccad1f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:42.558792 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-714108e5-ecf7-470b-86bf-5a1672ccad1f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1242 microversion: 2.1 time: 0.066701 May 26 16:58:42.559663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 304/628] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:42 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:42.820847 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-aa5f2f0a-b526-45c9-b384-59d997ebff4a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:42.821520 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-aa5f2f0a-b526-45c9-b384-59d997ebff4a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:42.827992 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-aa5f2f0a-b526-45c9-b384-59d997ebff4a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:42.828448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-aa5f2f0a-b526-45c9-b384-59d997ebff4a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:42.829220 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-aa5f2f0a-b526-45c9-b384-59d997ebff4a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:42.829698 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-aa5f2f0a-b526-45c9-b384-59d997ebff4a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:42.982296 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-aa5f2f0a-b526-45c9-b384-59d997ebff4a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:42.993038 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-aa5f2f0a-b526-45c9-b384-59d997ebff4a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:42.995198 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-aa5f2f0a-b526-45c9-b384-59d997ebff4a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:43.001314 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-aa5f2f0a-b526-45c9-b384-59d997ebff4a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1723 microversion: 2.20 time: 0.180476 May 26 16:58:43.008054 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 325/629] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:58:42 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:43.442241 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-118156e3-9fc4-4cb9-a7cc-0b80f3473fcd req-bbe2d413-3e82-424d-a435-c686e8f229fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0daf7ae-8eab-479b-b4cb-380a68f5bfaa", "name": "network-vif-deleted", "tag": "19f830e3-9d14-4893-a727-3c20d5993b34"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:43.451975 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-118156e3-9fc4-4cb9-a7cc-0b80f3473fcd req-bbe2d413-3e82-424d-a435-c686e8f229fd service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:43.457569 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-118156e3-9fc4-4cb9-a7cc-0b80f3473fcd req-bbe2d413-3e82-424d-a435-c686e8f229fd service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:43.464340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-118156e3-9fc4-4cb9-a7cc-0b80f3473fcd req-bbe2d413-3e82-424d-a435-c686e8f229fd service nova] Creating event network-vif-deleted:19f830e3-9d14-4893-a727-3c20d5993b34 for instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa on hv-cinder-83607 May 26 16:58:43.470133 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-118156e3-9fc4-4cb9-a7cc-0b80f3473fcd req-bbe2d413-3e82-424d-a435-c686e8f229fd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032562 May 26 16:58:43.471273 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 305/630] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:43.578892 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a7f6bddb-5ea5-4f35-8924-561b36c8c87d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:43.579538 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a7f6bddb-5ea5-4f35-8924-561b36c8c87d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:43.586839 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a7f6bddb-5ea5-4f35-8924-561b36c8c87d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:43.587289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a7f6bddb-5ea5-4f35-8924-561b36c8c87d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:43.588219 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a7f6bddb-5ea5-4f35-8924-561b36c8c87d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:43.588807 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a7f6bddb-5ea5-4f35-8924-561b36c8c87d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:43.667032 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a7f6bddb-5ea5-4f35-8924-561b36c8c87d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:43.677239 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a7f6bddb-5ea5-4f35-8924-561b36c8c87d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1246 microversion: 2.1 time: 0.103113 May 26 16:58:43.681313 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 326/631] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:43 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1246 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:44.016782 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-77554ee6-4bd3-4843-b339-21b7cbb5f82b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:44.017516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-77554ee6-4bd3-4843-b339-21b7cbb5f82b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:44.025036 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77554ee6-4bd3-4843-b339-21b7cbb5f82b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:44.025534 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77554ee6-4bd3-4843-b339-21b7cbb5f82b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:44.026334 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77554ee6-4bd3-4843-b339-21b7cbb5f82b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:44.026760 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77554ee6-4bd3-4843-b339-21b7cbb5f82b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:44.061560 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77554ee6-4bd3-4843-b339-21b7cbb5f82b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:44.062018 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-77554ee6-4bd3-4843-b339-21b7cbb5f82b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:44.062512 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-77554ee6-4bd3-4843-b339-21b7cbb5f82b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lazy-loading 'fault' on Instance uuid d0daf7ae-8eab-479b-b4cb-380a68f5bfaa {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:58:44.117906 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-77554ee6-4bd3-4843-b339-21b7cbb5f82b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:44.126571 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-77554ee6-4bd3-4843-b339-21b7cbb5f82b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:44.128637 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-77554ee6-4bd3-4843-b339-21b7cbb5f82b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:44.129859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-77554ee6-4bd3-4843-b339-21b7cbb5f82b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 200 len: 1371 microversion: 2.20 time: 0.117520 May 26 16:58:44.130419 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 306/632] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:58:44 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 1371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:58:44.696661 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-45c24790-f788-4f94-bbd6-dba21ad716dc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:44.697748 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-45c24790-f788-4f94-bbd6-dba21ad716dc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:44.703913 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-45c24790-f788-4f94-bbd6-dba21ad716dc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:44.704439 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-45c24790-f788-4f94-bbd6-dba21ad716dc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:44.705147 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-45c24790-f788-4f94-bbd6-dba21ad716dc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:44.705817 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-45c24790-f788-4f94-bbd6-dba21ad716dc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:44.775667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-45c24790-f788-4f94-bbd6-dba21ad716dc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:44.784515 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-45c24790-f788-4f94-bbd6-dba21ad716dc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1294 microversion: 2.1 time: 0.093618 May 26 16:58:44.784767 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 327/633] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:44 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:45.150354 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f4d33514-7ceb-407a-ace8-ccbf0eb4d6f8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:45.154651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f4d33514-7ceb-407a-ace8-ccbf0eb4d6f8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:45.157558 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4d33514-7ceb-407a-ace8-ccbf0eb4d6f8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:45.158010 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4d33514-7ceb-407a-ace8-ccbf0eb4d6f8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:45.158773 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4d33514-7ceb-407a-ace8-ccbf0eb4d6f8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:45.159258 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4d33514-7ceb-407a-ace8-ccbf0eb4d6f8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:45.172959 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-f4d33514-7ceb-407a-ace8-ccbf0eb4d6f8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] HTTP exception thrown: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f4d33514-7ceb-407a-ace8-ccbf0eb4d6f8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Request method failure captured: May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa HTTP/1.1 May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7CMO7vth5eNDcoH0uz1xJNZdPXIZnJLGNtQq4hjl3sTAcyM9bTxVOIlXLoAqJUWVO9-AwO5XimbF_dn1eKAMayd6r5UUnykoRR3-I1zg_VgHC6V1ooZ8TUqg792dtGpI58oG1rI2FW9B69QLh8I76O7tvP1kLQrJ56fbfNGZd_dSb8 May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Openstack-Nova-Api-Version: 2.20 May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 5a16c7d70bb14cd3b898751084649cd2 May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-709675682 May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 16:58:45.174663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 16:58:45.176243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a16c7d70bb14cd3b898751084649cd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a16c7d70bb14cd3b898751084649cd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5a16c7d70bb14cd3b898751084649cd2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5a16c7d70bb14cd3b898751084649cd2"}]}] May 26 16:58:45.176243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeShelveTestJSON-709675682 May 26 16:58:45.176243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 5a16c7d70bb14cd3b898751084649cd2 May 26 16:58:45.176243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-709675682 May 26 16:58:45.176243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeShelveTestJSON-709675682-project May 26 16:58:45.176243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 16:58:45.176243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 16:58:45.176243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: 89f20368c3a747a49a3aaa556115d169 May 26 16:58:45.176243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeShelveTestJSON-709675682-project May 26 16:58:45.176243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 16:58:45.176243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. May 26 16:58:45.176243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': 'd0daf7ae-8eab-479b-b4cb-380a68f5bfaa'} May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:58:45.177171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. May 26 16:58:45.178662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:58:45.179925 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f4d33514-7ceb-407a-ace8-ccbf0eb4d6f8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Returning 404 to user: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:58:45.179925 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f4d33514-7ceb-407a-ace8-ccbf0eb4d6f8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 404 len: 111 microversion: 2.20 time: 0.029651 May 26 16:58:45.179925 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 307/634] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:58:45 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 16:58:45.188939 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-0c873ff8-af96-4f83-a4ef-0ceb919e9234 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '.version_select at 0x7fbe80436280>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:45.289637 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-0c873ff8-af96-4f83-a4ef-0ceb919e9234 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1783983421" status: 204 len: 0 microversion: 2.20 time: 0.104563 May 26 16:58:45.290263 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 328/635] 10.222.0.48 () {60 vars in 1261 bytes} [Thu May 26 16:58:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1783983421 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 26 16:58:45.801927 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-13aed977-1e79-478c-b61a-26350c6b9adc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:45.802615 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-13aed977-1e79-478c-b61a-26350c6b9adc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:45.809427 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13aed977-1e79-478c-b61a-26350c6b9adc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:45.809886 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13aed977-1e79-478c-b61a-26350c6b9adc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:45.810672 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13aed977-1e79-478c-b61a-26350c6b9adc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:45.811179 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13aed977-1e79-478c-b61a-26350c6b9adc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:45.890290 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-13aed977-1e79-478c-b61a-26350c6b9adc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:45.898945 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-13aed977-1e79-478c-b61a-26350c6b9adc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1312 microversion: 2.1 time: 0.101214 May 26 16:58:45.899616 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 308/636] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:45 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:46.192788 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1183103394", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1495379482", "security_groups": [{"name": "tempest-secgroup-smoke-135469612"}], "networks": [{"uuid": "083fb909-4ca5-4768-88fe-a9b00dc0a812"}], "block_device_mapping_v2": [{"uuid": "cb401177-8d1c-4a5b-be1a-e7b00d4dd9d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:46.310017 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.network.neutron [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] validate_networks() for [('083fb909-4ca5-4768-88fe-a9b00dc0a812', None, None, None, None, None)] {{(pid=124836) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:58:46.694747 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Flavor limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:58:46.695199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Image limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:58:46.695711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Flavor pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:58:46.696127 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Image pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:58:46.696544 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:58:46.705768 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:46.706215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:46.707018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:46.707454 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:46.725891 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Getting quotas for project b9562e9c747f4808a67c01436d9ede47. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:58:46.748835 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Getting quotas for user 4e68c10e83634018b70ca664e1e8f08c and project b9562e9c747f4808a67c01436d9ede47. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:58:46.773230 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-55584d47-0de0-4fb1-8089-e3957bb384d9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Action: 'create', calling method: .version_select at 0x7fbe803510d0>, body: {"keypair": {"name": "tempest-keypair-307988715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFH9T5j8zJ0DjNbNUwky3itju86KxCB3qncsUDWHU7OH76zqtsvF2MPAzEVM7epEEbZarRL7EzIG/FmP3kbnw4Kpx3p6b+eoU3J25gpDoNPhjE2K23mPYt+FN2bMsbOIUw=="}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:46.796222 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-55584d47-0de0-4fb1-8089-e3957bb384d9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Getting quotas for project 5a16c7d70bb14cd3b898751084649cd2. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:58:46.802709 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-55584d47-0de0-4fb1-8089-e3957bb384d9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Getting quotas for user 89f20368c3a747a49a3aaa556115d169 and project 5a16c7d70bb14cd3b898751084649cd2. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:58:46.831315 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Going to run 1 instances... {{(pid=124836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:58:46.835246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cb401177-8d1c-4a5b-be1a-e7b00d4dd9d3',volume_size=None,volume_type=None)] {{(pid=124836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:58:47.005902 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-55584d47-0de0-4fb1-8089-e3957bb384d9 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.237620 May 26 16:58:47.006958 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 309/637] 10.222.0.48 () {62 vars in 1199 bytes} [Thu May 26 16:58:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 239 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 26 16:58:47.022285 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5d09b659-b9df-4124-acad-5c75531cea58 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:47.023767 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5d09b659-b9df-4124-acad-5c75531cea58 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:47.034457 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5d09b659-b9df-4124-acad-5c75531cea58 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:47.046797 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5d09b659-b9df-4124-acad-5c75531cea58 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:47.046797 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5d09b659-b9df-4124-acad-5c75531cea58 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:47.046797 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5d09b659-b9df-4124-acad-5c75531cea58 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:47.224160 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5d09b659-b9df-4124-acad-5c75531cea58 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:47.235798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5d09b659-b9df-4124-acad-5c75531cea58 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1367 microversion: 2.1 time: 0.227925 May 26 16:58:47.249304 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 310/638] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:47 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:47.381366 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8d30a9b0-4f1f-42b1-860a-0c4dc76f93a4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.192982 May 26 16:58:47.382611 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 329/639] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 16:58:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 16:58:47.394277 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-38a3c3ab-7bbf-41a7-985d-713bae0c1088 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:47.395845 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-38a3c3ab-7bbf-41a7-985d-713bae0c1088 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:47.482344 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-38a3c3ab-7bbf-41a7-985d-713bae0c1088 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:47.495261 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-38a3c3ab-7bbf-41a7-985d-713bae0c1088 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1089 microversion: 2.1 time: 0.104759 May 26 16:58:47.496043 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 311/640] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:47 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1089 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:48.039629 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-71e6f73f-276f-452f-bc6b-078473d155f7 req-69ae9f94-edc8-4ac4-8866-7e42f25ee785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3", "tag": "c72abf78-d876-4b2c-8de8-12d16d44d3a0"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:48.052258 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-71e6f73f-276f-452f-bc6b-078473d155f7 req-69ae9f94-edc8-4ac4-8866-7e42f25ee785 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:48.053000 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-71e6f73f-276f-452f-bc6b-078473d155f7 req-69ae9f94-edc8-4ac4-8866-7e42f25ee785 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:48.069708 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-71e6f73f-276f-452f-bc6b-078473d155f7 req-69ae9f94-edc8-4ac4-8866-7e42f25ee785 service nova] Creating event network-changed:c72abf78-d876-4b2c-8de8-12d16d44d3a0 for instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 on hv-cinder-83607 May 26 16:58:48.075557 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-71e6f73f-276f-452f-bc6b-078473d155f7 req-69ae9f94-edc8-4ac4-8866-7e42f25ee785 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041154 May 26 16:58:48.076699 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 330/641] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:48.255382 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c8210169-6da8-4dde-baca-bc2f2d0e0af7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:48.256000 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c8210169-6da8-4dde-baca-bc2f2d0e0af7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:48.263470 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c8210169-6da8-4dde-baca-bc2f2d0e0af7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:48.263880 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c8210169-6da8-4dde-baca-bc2f2d0e0af7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:48.264649 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c8210169-6da8-4dde-baca-bc2f2d0e0af7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:48.265084 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c8210169-6da8-4dde-baca-bc2f2d0e0af7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:48.432396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c8210169-6da8-4dde-baca-bc2f2d0e0af7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:48.444102 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c8210169-6da8-4dde-baca-bc2f2d0e0af7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1367 microversion: 2.1 time: 0.193080 May 26 16:58:48.444689 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 312/642] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:48 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:48.513050 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-29a9f1ed-f8dc-4a17-8e79-32a0b4e337f7 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:48.513764 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-29a9f1ed-f8dc-4a17-8e79-32a0b4e337f7 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:48.609573 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-29a9f1ed-f8dc-4a17-8e79-32a0b4e337f7 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:48.617922 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-29a9f1ed-f8dc-4a17-8e79-32a0b4e337f7 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1089 microversion: 2.1 time: 0.109365 May 26 16:58:48.618404 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 331/643] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:48 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1089 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:49.461419 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-70dd5bdd-2504-4efb-a7a7-5b70378180e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:49.461966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-70dd5bdd-2504-4efb-a7a7-5b70378180e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:49.468425 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-70dd5bdd-2504-4efb-a7a7-5b70378180e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:49.468878 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-70dd5bdd-2504-4efb-a7a7-5b70378180e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:49.469680 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-70dd5bdd-2504-4efb-a7a7-5b70378180e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:49.470114 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-70dd5bdd-2504-4efb-a7a7-5b70378180e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:49.635243 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-27890dce-d7f3-4c54-848f-736042e0cfbb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:49.635863 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-27890dce-d7f3-4c54-848f-736042e0cfbb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:49.643352 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-27890dce-d7f3-4c54-848f-736042e0cfbb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:49.643831 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-27890dce-d7f3-4c54-848f-736042e0cfbb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:49.644591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-27890dce-d7f3-4c54-848f-736042e0cfbb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:49.645027 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-27890dce-d7f3-4c54-848f-736042e0cfbb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:49.675193 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-70dd5bdd-2504-4efb-a7a7-5b70378180e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:49.683445 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-70dd5bdd-2504-4efb-a7a7-5b70378180e0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1367 microversion: 2.1 time: 0.225889 May 26 16:58:49.683983 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 313/644] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:49 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:49.723905 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-27890dce-d7f3-4c54-848f-736042e0cfbb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:49.729007 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-27890dce-d7f3-4c54-848f-736042e0cfbb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1131 microversion: 2.1 time: 0.097770 May 26 16:58:49.729611 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 332/645] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:49 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1131 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:49.878428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-572610714", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b6693f4-44e6-4850-bb10-714588f8b298"}], "security_groups": [{"name": "tempest-securitygroup--956757562"}], "key_name": "tempest-keypair-307988715", "user_data": "}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:49.981291 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] validate_networks() for [('8b6693f4-44e6-4850-bb10-714588f8b298', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:58:50.417559 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:58:50.417988 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:58:50.418495 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:58:50.418949 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:58:50.419395 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:58:50.429225 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:50.429786 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:50.431416 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:50.431416 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:50.450221 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Getting quotas for project 5a16c7d70bb14cd3b898751084649cd2. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:58:50.454376 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Getting quotas for user 89f20368c3a747a49a3aaa556115d169 and project 5a16c7d70bb14cd3b898751084649cd2. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:58:50.467955 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:58:50.470914 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:58:50.702022 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-0a317bf8-0111-4943-a689-406f045e681a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:50.703080 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-0a317bf8-0111-4943-a689-406f045e681a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:50.711442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0a317bf8-0111-4943-a689-406f045e681a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:50.711890 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0a317bf8-0111-4943-a689-406f045e681a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:50.712731 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0a317bf8-0111-4943-a689-406f045e681a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:50.713166 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0a317bf8-0111-4943-a689-406f045e681a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:50.731259 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bbedbfae-ce02-4c1d-a3a0-f9e31fe428a4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.857064 May 26 16:58:50.737713 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 314/646] 10.222.0.48 () {62 vars in 1187 bytes} [Thu May 26 16:58:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 16:58:50.743013 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-85c6b95d-4610-4cd0-87cc-d0e5619200ec tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:50.743719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-85c6b95d-4610-4cd0-87cc-d0e5619200ec tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:50.832822 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-85c6b95d-4610-4cd0-87cc-d0e5619200ec tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:50.836042 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-85c6b95d-4610-4cd0-87cc-d0e5619200ec tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:50.837762 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-85c6b95d-4610-4cd0-87cc-d0e5619200ec tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:50.839578 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-85c6b95d-4610-4cd0-87cc-d0e5619200ec tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1280 microversion: 2.20 time: 0.099920 May 26 16:58:50.840354 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 315/647] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:58:50 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1280 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:50.844984 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-213f8b25-814e-41fd-8a6b-e8c0305d419a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:50.845832 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-213f8b25-814e-41fd-8a6b-e8c0305d419a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:50.847863 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:50.853554 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-213f8b25-814e-41fd-8a6b-e8c0305d419a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:50.855501 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-213f8b25-814e-41fd-8a6b-e8c0305d419a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:50.855501 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-213f8b25-814e-41fd-8a6b-e8c0305d419a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:50.855501 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-213f8b25-814e-41fd-8a6b-e8c0305d419a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:50.913092 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-0a317bf8-0111-4943-a689-406f045e681a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:50.922568 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-0a317bf8-0111-4943-a689-406f045e681a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1367 microversion: 2.1 time: 0.225313 May 26 16:58:50.923171 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 333/648] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:50 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:50.935221 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-213f8b25-814e-41fd-8a6b-e8c0305d419a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:50.945315 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-213f8b25-814e-41fd-8a6b-e8c0305d419a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1187 microversion: 2.1 time: 0.103929 May 26 16:58:50.946029 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 316/649] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:50 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:51.857674 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3f945a5d-d5d6-4730-9eb8-362c95ecc27e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:51.859929 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3f945a5d-d5d6-4730-9eb8-362c95ecc27e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:51.866670 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3f945a5d-d5d6-4730-9eb8-362c95ecc27e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:51.867399 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3f945a5d-d5d6-4730-9eb8-362c95ecc27e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:51.868183 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3f945a5d-d5d6-4730-9eb8-362c95ecc27e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:51.868844 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3f945a5d-d5d6-4730-9eb8-362c95ecc27e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:51.937828 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3f945a5d-d5d6-4730-9eb8-362c95ecc27e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:51.946715 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-37c20fe8-7ed6-4bbd-8cb5-2832dffec0ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:51.947435 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-37c20fe8-7ed6-4bbd-8cb5-2832dffec0ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:51.948801 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3f945a5d-d5d6-4730-9eb8-362c95ecc27e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:51.950618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3f945a5d-d5d6-4730-9eb8-362c95ecc27e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:51.952466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3f945a5d-d5d6-4730-9eb8-362c95ecc27e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1284 microversion: 2.20 time: 0.099012 May 26 16:58:51.953043 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 334/650] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:58:51 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:51.964696 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a36ef8d6-b1fe-41b8-b053-394002e259a8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:51.965244 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a36ef8d6-b1fe-41b8-b053-394002e259a8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:51.965738 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-37c20fe8-7ed6-4bbd-8cb5-2832dffec0ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:51.966208 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-37c20fe8-7ed6-4bbd-8cb5-2832dffec0ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:51.967157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-37c20fe8-7ed6-4bbd-8cb5-2832dffec0ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:51.967755 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-37c20fe8-7ed6-4bbd-8cb5-2832dffec0ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:51.972194 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a36ef8d6-b1fe-41b8-b053-394002e259a8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:51.972951 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:51.973062 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a36ef8d6-b1fe-41b8-b053-394002e259a8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:51.973851 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a36ef8d6-b1fe-41b8-b053-394002e259a8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:51.974201 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a36ef8d6-b1fe-41b8-b053-394002e259a8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:52.075549 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a36ef8d6-b1fe-41b8-b053-394002e259a8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:52.092066 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a36ef8d6-b1fe-41b8-b053-394002e259a8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1205 microversion: 2.1 time: 0.126353 May 26 16:58:52.092066 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 335/651] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:51 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1205 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:52.136817 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-37c20fe8-7ed6-4bbd-8cb5-2832dffec0ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:52.144646 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-37c20fe8-7ed6-4bbd-8cb5-2832dffec0ba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1367 microversion: 2.1 time: 0.201836 May 26 16:58:52.145227 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 317/652] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:51 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:52.971854 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5d5751f5-5441-4f1c-a276-0f0c15a7e908 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:52.972969 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5d5751f5-5441-4f1c-a276-0f0c15a7e908 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:52.975967 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:52.981778 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d5751f5-5441-4f1c-a276-0f0c15a7e908 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:52.982246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d5751f5-5441-4f1c-a276-0f0c15a7e908 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:52.983019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d5751f5-5441-4f1c-a276-0f0c15a7e908 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:52.983452 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d5751f5-5441-4f1c-a276-0f0c15a7e908 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:53.069615 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5d5751f5-5441-4f1c-a276-0f0c15a7e908 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:53.078941 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5d5751f5-5441-4f1c-a276-0f0c15a7e908 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:53.080712 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5d5751f5-5441-4f1c-a276-0f0c15a7e908 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:53.086540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5d5751f5-5441-4f1c-a276-0f0c15a7e908 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1332 microversion: 2.20 time: 0.119509 May 26 16:58:53.093688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 336/653] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:58:52 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1332 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:53.105109 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-13f81d95-33a4-4216-96ee-678a99d353b0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:53.106521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-13f81d95-33a4-4216-96ee-678a99d353b0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:53.116296 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13f81d95-33a4-4216-96ee-678a99d353b0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:53.118650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13f81d95-33a4-4216-96ee-678a99d353b0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:53.118650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13f81d95-33a4-4216-96ee-678a99d353b0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:53.118650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-13f81d95-33a4-4216-96ee-678a99d353b0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:53.162792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9b2a475c-3b4e-4d44-becd-bbeff4fcb41f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:53.164617 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9b2a475c-3b4e-4d44-becd-bbeff4fcb41f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:53.175355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b2a475c-3b4e-4d44-becd-bbeff4fcb41f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:53.177907 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b2a475c-3b4e-4d44-becd-bbeff4fcb41f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:53.178987 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b2a475c-3b4e-4d44-becd-bbeff4fcb41f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:53.181803 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b2a475c-3b4e-4d44-becd-bbeff4fcb41f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:53.426414 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-13f81d95-33a4-4216-96ee-678a99d353b0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:53.437829 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-13f81d95-33a4-4216-96ee-678a99d353b0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1272 microversion: 2.1 time: 0.338314 May 26 16:58:53.440703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 318/654] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:53 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1272 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:53.505058 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9b2a475c-3b4e-4d44-becd-bbeff4fcb41f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:53.514090 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9b2a475c-3b4e-4d44-becd-bbeff4fcb41f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1367 microversion: 2.1 time: 0.356506 May 26 16:58:53.514925 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 337/655] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:53 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1367 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:53.566134 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-2d640b57-398b-40ea-9204-a93b60a71e9a req-43af07d9-b341-42c8-a8b3-671d7e0f9e9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b981b012-8995-4185-9b5c-03934263a18c", "tag": "dd6991b4-2331-41f4-a211-234d1b499987"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:53.577237 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-2d640b57-398b-40ea-9204-a93b60a71e9a req-43af07d9-b341-42c8-a8b3-671d7e0f9e9c service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:53.578282 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-2d640b57-398b-40ea-9204-a93b60a71e9a req-43af07d9-b341-42c8-a8b3-671d7e0f9e9c service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:53.590505 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-2d640b57-398b-40ea-9204-a93b60a71e9a req-43af07d9-b341-42c8-a8b3-671d7e0f9e9c service nova] Creating event network-changed:dd6991b4-2331-41f4-a211-234d1b499987 for instance b981b012-8995-4185-9b5c-03934263a18c on hv-cinder-83607 May 26 16:58:53.595782 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-2d640b57-398b-40ea-9204-a93b60a71e9a req-43af07d9-b341-42c8-a8b3-671d7e0f9e9c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136177 May 26 16:58:53.596999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 319/656] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:58:54.106319 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-08f8827e-c92b-419d-8b40-27618e139614 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:54.106954 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-08f8827e-c92b-419d-8b40-27618e139614 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:54.115365 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-08f8827e-c92b-419d-8b40-27618e139614 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:54.115973 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-08f8827e-c92b-419d-8b40-27618e139614 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:54.116769 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-08f8827e-c92b-419d-8b40-27618e139614 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:54.117246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-08f8827e-c92b-419d-8b40-27618e139614 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:54.193818 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-08f8827e-c92b-419d-8b40-27618e139614 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:54.202216 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-08f8827e-c92b-419d-8b40-27618e139614 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:54.203774 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-08f8827e-c92b-419d-8b40-27618e139614 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:54.204892 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-08f8827e-c92b-419d-8b40-27618e139614 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1338 microversion: 2.20 time: 0.103757 May 26 16:58:54.206480 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 338/657] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:58:54 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:54.456181 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bd4977ba-badd-428c-b894-b2610408a143 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:54.457089 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bd4977ba-badd-428c-b894-b2610408a143 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:54.464080 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bd4977ba-badd-428c-b894-b2610408a143 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:54.467913 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bd4977ba-badd-428c-b894-b2610408a143 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:54.467913 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bd4977ba-badd-428c-b894-b2610408a143 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:54.467913 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bd4977ba-badd-428c-b894-b2610408a143 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:54.533075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-cb297bc3-7e20-424d-b322-d1c65901312f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:54.533746 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-cb297bc3-7e20-424d-b322-d1c65901312f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:54.540044 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cb297bc3-7e20-424d-b322-d1c65901312f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:54.540785 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cb297bc3-7e20-424d-b322-d1c65901312f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:54.541595 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cb297bc3-7e20-424d-b322-d1c65901312f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:54.542031 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cb297bc3-7e20-424d-b322-d1c65901312f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:54.667680 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bd4977ba-badd-428c-b894-b2610408a143 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:54.680177 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bd4977ba-badd-428c-b894-b2610408a143 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1260 microversion: 2.1 time: 0.225261 May 26 16:58:54.680177 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 320/658] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:54 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:54.721622 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-cb297bc3-7e20-424d-b322-d1c65901312f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:54.730867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-cb297bc3-7e20-424d-b322-d1c65901312f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1367 microversion: 2.1 time: 0.201998 May 26 16:58:54.731529 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 339/659] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:54 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:55.225334 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0f53270c-50e0-49c1-8d9e-f4528d16e8cd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:55.225946 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0f53270c-50e0-49c1-8d9e-f4528d16e8cd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:55.232104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0f53270c-50e0-49c1-8d9e-f4528d16e8cd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:55.232549 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0f53270c-50e0-49c1-8d9e-f4528d16e8cd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:55.233330 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0f53270c-50e0-49c1-8d9e-f4528d16e8cd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:55.233765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0f53270c-50e0-49c1-8d9e-f4528d16e8cd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:55.374011 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0f53270c-50e0-49c1-8d9e-f4528d16e8cd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:55.382037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-9a4eb8ca-f699-4396-a0a7-05a51eb39d47 req-3d7d4484-d720-4fe4-9bcd-95d4b47c929b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3", "name": "network-vif-plugged", "status": "completed", "tag": "c72abf78-d876-4b2c-8de8-12d16d44d3a0"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:55.388973 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0f53270c-50e0-49c1-8d9e-f4528d16e8cd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:55.390786 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0f53270c-50e0-49c1-8d9e-f4528d16e8cd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:55.392210 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-9a4eb8ca-f699-4396-a0a7-05a51eb39d47 req-3d7d4484-d720-4fe4-9bcd-95d4b47c929b service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:55.392367 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0f53270c-50e0-49c1-8d9e-f4528d16e8cd tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1405 microversion: 2.20 time: 0.171930 May 26 16:58:55.393224 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-9a4eb8ca-f699-4396-a0a7-05a51eb39d47 req-3d7d4484-d720-4fe4-9bcd-95d4b47c929b service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:55.393634 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 321/660] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:58:55 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:55.405496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-9a4eb8ca-f699-4396-a0a7-05a51eb39d47 req-3d7d4484-d720-4fe4-9bcd-95d4b47c929b service nova] Creating event network-vif-plugged:c72abf78-d876-4b2c-8de8-12d16d44d3a0 for instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 on hv-cinder-83607 May 26 16:58:55.410580 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-9a4eb8ca-f699-4396-a0a7-05a51eb39d47 req-3d7d4484-d720-4fe4-9bcd-95d4b47c929b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032103 May 26 16:58:55.411913 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 340/661] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:58:55.694839 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3ebc493f-1be8-441d-9c0c-b13b312f2e42 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:55.695488 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3ebc493f-1be8-441d-9c0c-b13b312f2e42 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:55.704809 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3ebc493f-1be8-441d-9c0c-b13b312f2e42 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:55.706000 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3ebc493f-1be8-441d-9c0c-b13b312f2e42 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:55.706790 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3ebc493f-1be8-441d-9c0c-b13b312f2e42 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:55.707242 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3ebc493f-1be8-441d-9c0c-b13b312f2e42 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:55.749731 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-917ab0f6-05d3-4f41-95c7-a14b5855d4e3 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:55.758713 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-917ab0f6-05d3-4f41-95c7-a14b5855d4e3 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:55.766183 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-917ab0f6-05d3-4f41-95c7-a14b5855d4e3 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:55.766967 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-917ab0f6-05d3-4f41-95c7-a14b5855d4e3 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:55.768459 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-917ab0f6-05d3-4f41-95c7-a14b5855d4e3 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:55.768895 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-917ab0f6-05d3-4f41-95c7-a14b5855d4e3 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:55.914398 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3ebc493f-1be8-441d-9c0c-b13b312f2e42 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:55.923630 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3ebc493f-1be8-441d-9c0c-b13b312f2e42 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1260 microversion: 2.1 time: 0.234037 May 26 16:58:55.924700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 322/662] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:55 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:55.944718 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-917ab0f6-05d3-4f41-95c7-a14b5855d4e3 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:55.947017 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:55.952957 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-917ab0f6-05d3-4f41-95c7-a14b5855d4e3 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1367 microversion: 2.1 time: 0.207480 May 26 16:58:55.953554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 341/663] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:55 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:56.349324 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-3e0f8f10-29de-46da-8b4a-448043bc20b8 req-b91e0427-56cf-4572-90f3-706afc07b380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ca388b-87f7-46b3-81f0-5e7d06e9dcc1", "tag": "17153ebf-8de6-4b1d-bafd-f2c2e8580998"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:58:56.358054 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-3e0f8f10-29de-46da-8b4a-448043bc20b8 req-b91e0427-56cf-4572-90f3-706afc07b380 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:56.371344 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-3e0f8f10-29de-46da-8b4a-448043bc20b8 req-b91e0427-56cf-4572-90f3-706afc07b380 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:56.371344 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-3e0f8f10-29de-46da-8b4a-448043bc20b8 req-b91e0427-56cf-4572-90f3-706afc07b380 service nova] Creating event network-changed:17153ebf-8de6-4b1d-bafd-f2c2e8580998 for instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 on hv-cinder-83607 May 26 16:58:56.377280 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-3e0f8f10-29de-46da-8b4a-448043bc20b8 req-b91e0427-56cf-4572-90f3-706afc07b380 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032134 May 26 16:58:56.377631 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 323/664] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:56.412258 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-49a8faf9-744e-48ba-b1eb-aeed05dfe28e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:56.413163 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-49a8faf9-744e-48ba-b1eb-aeed05dfe28e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:56.420737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-49a8faf9-744e-48ba-b1eb-aeed05dfe28e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:56.421189 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-49a8faf9-744e-48ba-b1eb-aeed05dfe28e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:56.422053 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-49a8faf9-744e-48ba-b1eb-aeed05dfe28e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:56.422497 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-49a8faf9-744e-48ba-b1eb-aeed05dfe28e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:56.561199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-49a8faf9-744e-48ba-b1eb-aeed05dfe28e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:56.569587 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-49a8faf9-744e-48ba-b1eb-aeed05dfe28e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:56.571129 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-49a8faf9-744e-48ba-b1eb-aeed05dfe28e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:56.572273 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-49a8faf9-744e-48ba-b1eb-aeed05dfe28e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1405 microversion: 2.20 time: 0.164778 May 26 16:58:56.572825 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 342/665] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:58:56 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:56.942152 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1f9ab479-8429-4dc5-b561-ea8b3128bfa4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:56.943075 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1f9ab479-8429-4dc5-b561-ea8b3128bfa4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:56.950149 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f9ab479-8429-4dc5-b561-ea8b3128bfa4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:56.950598 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f9ab479-8429-4dc5-b561-ea8b3128bfa4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:56.951463 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f9ab479-8429-4dc5-b561-ea8b3128bfa4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:56.951906 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1f9ab479-8429-4dc5-b561-ea8b3128bfa4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:56.976439 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-12cd1f44-2f8a-4565-8594-75a63cbff5ea tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:56.977297 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-12cd1f44-2f8a-4565-8594-75a63cbff5ea tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:56.979257 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=4 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:56.984727 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-12cd1f44-2f8a-4565-8594-75a63cbff5ea tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:56.985304 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-12cd1f44-2f8a-4565-8594-75a63cbff5ea tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:56.986231 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-12cd1f44-2f8a-4565-8594-75a63cbff5ea tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:56.986612 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-12cd1f44-2f8a-4565-8594-75a63cbff5ea tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:57.166661 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1f9ab479-8429-4dc5-b561-ea8b3128bfa4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:57.175102 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1f9ab479-8429-4dc5-b561-ea8b3128bfa4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1260 microversion: 2.1 time: 0.237645 May 26 16:58:57.175709 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 324/666] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:56 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:57.184097 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-12cd1f44-2f8a-4565-8594-75a63cbff5ea tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:57.192355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-12cd1f44-2f8a-4565-8594-75a63cbff5ea tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1367 microversion: 2.1 time: 0.220452 May 26 16:58:57.192929 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 343/667] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:56 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:57.591002 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-20dc8511-c691-432a-ba77-d8bd3c7f3a3e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:57.591621 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-20dc8511-c691-432a-ba77-d8bd3c7f3a3e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:57.598086 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-20dc8511-c691-432a-ba77-d8bd3c7f3a3e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:57.598803 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-20dc8511-c691-432a-ba77-d8bd3c7f3a3e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:57.599612 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-20dc8511-c691-432a-ba77-d8bd3c7f3a3e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:57.601314 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-20dc8511-c691-432a-ba77-d8bd3c7f3a3e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:57.732621 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-20dc8511-c691-432a-ba77-d8bd3c7f3a3e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:57.742495 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-20dc8511-c691-432a-ba77-d8bd3c7f3a3e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:57.744000 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-20dc8511-c691-432a-ba77-d8bd3c7f3a3e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:57.745140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-20dc8511-c691-432a-ba77-d8bd3c7f3a3e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1405 microversion: 2.20 time: 0.158168 May 26 16:58:57.745937 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 325/668] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:58:57 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:58.192486 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ae697079-2629-4f62-8f00-bbb2e9fd4e95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:58.193070 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ae697079-2629-4f62-8f00-bbb2e9fd4e95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:58.199668 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ae697079-2629-4f62-8f00-bbb2e9fd4e95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:58.200125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ae697079-2629-4f62-8f00-bbb2e9fd4e95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:58.200896 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ae697079-2629-4f62-8f00-bbb2e9fd4e95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:58.201393 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ae697079-2629-4f62-8f00-bbb2e9fd4e95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:58.209644 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-787019c7-4009-4acb-80bb-2f95ce70adaa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:58.210270 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-787019c7-4009-4acb-80bb-2f95ce70adaa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:58.217055 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-787019c7-4009-4acb-80bb-2f95ce70adaa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:58.225999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-787019c7-4009-4acb-80bb-2f95ce70adaa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:58.225999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-787019c7-4009-4acb-80bb-2f95ce70adaa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:58.225999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-787019c7-4009-4acb-80bb-2f95ce70adaa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:58.409046 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ae697079-2629-4f62-8f00-bbb2e9fd4e95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:58.416509 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-787019c7-4009-4acb-80bb-2f95ce70adaa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:58.417161 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ae697079-2629-4f62-8f00-bbb2e9fd4e95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1260 microversion: 2.1 time: 0.229081 May 26 16:58:58.417780 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 344/669] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:58 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:58:58.425213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-787019c7-4009-4acb-80bb-2f95ce70adaa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1557 microversion: 2.1 time: 0.219647 May 26 16:58:58.425814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 326/670] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:58 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:58.441455 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e1764b9c-8417-4de7-adc2-0e75460787f9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:58.442124 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e1764b9c-8417-4de7-adc2-0e75460787f9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:58.448187 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e1764b9c-8417-4de7-adc2-0e75460787f9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:58.448649 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e1764b9c-8417-4de7-adc2-0e75460787f9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:58.449458 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e1764b9c-8417-4de7-adc2-0e75460787f9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:58.449928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e1764b9c-8417-4de7-adc2-0e75460787f9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:58.531571 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e1764b9c-8417-4de7-adc2-0e75460787f9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094235 May 26 16:58:58.532157 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 345/671] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 26 16:58:58 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:58:58.768214 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-40a368cf-b36a-4e26-94d7-ecffea2e3483 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:58.768872 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-40a368cf-b36a-4e26-94d7-ecffea2e3483 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:58.776008 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-40a368cf-b36a-4e26-94d7-ecffea2e3483 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:58.776462 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-40a368cf-b36a-4e26-94d7-ecffea2e3483 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:58.777248 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-40a368cf-b36a-4e26-94d7-ecffea2e3483 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:58.777718 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-40a368cf-b36a-4e26-94d7-ecffea2e3483 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.217998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=14 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:59.222690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b540bee0-8905-45ab-8264-f3bc0fe78aa5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:59.223936 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b540bee0-8905-45ab-8264-f3bc0fe78aa5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:59.230386 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b540bee0-8905-45ab-8264-f3bc0fe78aa5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:59.233587 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b540bee0-8905-45ab-8264-f3bc0fe78aa5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.233587 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b540bee0-8905-45ab-8264-f3bc0fe78aa5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:59.233587 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b540bee0-8905-45ab-8264-f3bc0fe78aa5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.264163 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b540bee0-8905-45ab-8264-f3bc0fe78aa5 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046762 May 26 16:58:59.264651 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 346/672] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 16:58:59 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 16:58:59.272380 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-40a368cf-b36a-4e26-94d7-ecffea2e3483 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:59.281440 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-40a368cf-b36a-4e26-94d7-ecffea2e3483 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:59.282942 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-40a368cf-b36a-4e26-94d7-ecffea2e3483 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:59.284256 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-40a368cf-b36a-4e26-94d7-ecffea2e3483 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1405 microversion: 2.20 time: 0.520917 May 26 16:58:59.284876 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 327/673] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:58:58 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1405 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:58:59.328887 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a264a11b-f1f0-4d38-94a2-6145819f0fce tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:59.329426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a264a11b-f1f0-4d38-94a2-6145819f0fce tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:59.336782 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a264a11b-f1f0-4d38-94a2-6145819f0fce tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:59.342382 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a264a11b-f1f0-4d38-94a2-6145819f0fce tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.342382 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a264a11b-f1f0-4d38-94a2-6145819f0fce tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:59.342382 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a264a11b-f1f0-4d38-94a2-6145819f0fce tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.364334 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a264a11b-f1f0-4d38-94a2-6145819f0fce tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Going to try to terminate instance {{(pid=124836) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:58:59.434581 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c987324c-2b06-45f9-a018-a1413b4a475d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:59.435237 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c987324c-2b06-45f9-a018-a1413b4a475d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:59.442146 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c987324c-2b06-45f9-a018-a1413b4a475d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:59.442613 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c987324c-2b06-45f9-a018-a1413b4a475d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.443386 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c987324c-2b06-45f9-a018-a1413b4a475d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:59.443833 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c987324c-2b06-45f9-a018-a1413b4a475d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.670718 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c987324c-2b06-45f9-a018-a1413b4a475d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:59.671874 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a264a11b-f1f0-4d38-94a2-6145819f0fce tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 204 len: 0 microversion: 2.1 time: 0.346507 May 26 16:58:59.672664 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 347/674] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 16:58:59 2022] DELETE /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:58:59.682403 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c987324c-2b06-45f9-a018-a1413b4a475d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1260 microversion: 2.1 time: 0.251557 May 26 16:58:59.682655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8605c200-72b5-4366-a4c1-d39dfe88e33d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:58:59.683051 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 328/675] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:59 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:58:59.683495 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8605c200-72b5-4366-a4c1-d39dfe88e33d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:58:59.700064 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8605c200-72b5-4366-a4c1-d39dfe88e33d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:59.700668 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8605c200-72b5-4366-a4c1-d39dfe88e33d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.701557 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8605c200-72b5-4366-a4c1-d39dfe88e33d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:58:59.702074 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8605c200-72b5-4366-a4c1-d39dfe88e33d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:58:59.894460 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8605c200-72b5-4366-a4c1-d39dfe88e33d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:58:59.902598 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8605c200-72b5-4366-a4c1-d39dfe88e33d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1671 microversion: 2.1 time: 0.224526 May 26 16:58:59.903172 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 348/676] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:58:59 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1671 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:00.097445 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-1ad528ef-5627-4311-933f-75050d9156b2 req-190986e0-54f0-45c1-8387-716daecdb4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3", "tag": "c72abf78-d876-4b2c-8de8-12d16d44d3a0"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:00.106674 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-1ad528ef-5627-4311-933f-75050d9156b2 req-190986e0-54f0-45c1-8387-716daecdb4b8 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.107394 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-1ad528ef-5627-4311-933f-75050d9156b2 req-190986e0-54f0-45c1-8387-716daecdb4b8 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.120381 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-1ad528ef-5627-4311-933f-75050d9156b2 req-190986e0-54f0-45c1-8387-716daecdb4b8 service nova] Creating event network-changed:c72abf78-d876-4b2c-8de8-12d16d44d3a0 for instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 on hv-cinder-83607 May 26 16:59:00.125824 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-1ad528ef-5627-4311-933f-75050d9156b2 req-190986e0-54f0-45c1-8387-716daecdb4b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095067 May 26 16:59:00.126516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 329/677] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:00.214624 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f0c9e2f6-e7c3-4cfb-964d-7f22297443aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:00.215212 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f0c9e2f6-e7c3-4cfb-964d-7f22297443aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:00.222422 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f0c9e2f6-e7c3-4cfb-964d-7f22297443aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.223129 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f0c9e2f6-e7c3-4cfb-964d-7f22297443aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.223880 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f0c9e2f6-e7c3-4cfb-964d-7f22297443aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.224318 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f0c9e2f6-e7c3-4cfb-964d-7f22297443aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.305015 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e696e3f4-3e38-4763-b59a-ab004d470dbe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:00.306028 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e696e3f4-3e38-4763-b59a-ab004d470dbe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:00.309238 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-f0c9e2f6-e7c3-4cfb-964d-7f22297443aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lazy-loading 'services' on Instance uuid 8efc5100-c116-4608-a1d9-26e418e0609e {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:59:00.312945 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e696e3f4-3e38-4763-b59a-ab004d470dbe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.313722 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e696e3f4-3e38-4763-b59a-ab004d470dbe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.314673 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e696e3f4-3e38-4763-b59a-ab004d470dbe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.315466 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e696e3f4-3e38-4763-b59a-ab004d470dbe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.440099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:00.455687 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e696e3f4-3e38-4763-b59a-ab004d470dbe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:00.468456 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e696e3f4-3e38-4763-b59a-ab004d470dbe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:00.470037 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e696e3f4-3e38-4763-b59a-ab004d470dbe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:00.474425 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e696e3f4-3e38-4763-b59a-ab004d470dbe tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1405 microversion: 2.20 time: 0.172899 May 26 16:59:00.474425 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 330/678] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:59:00 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:59:00.545398 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f0c9e2f6-e7c3-4cfb-964d-7f22297443aa tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-volume_attachments/485580ff-a759-4eba-a022-fb9d4043a653" status: 202 len: 0 microversion: 2.1 time: 0.334460 May 26 16:59:00.558259 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 349/679] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 26 16:59:00 2022] DELETE /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-volume_attachments/485580ff-a759-4eba-a022-fb9d4043a653 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:59:00.563573 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-83eb43b2-818b-4f42-8032-70afe3b20b09 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:00.564534 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-83eb43b2-818b-4f42-8032-70afe3b20b09 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:00.571368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83eb43b2-818b-4f42-8032-70afe3b20b09 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.571840 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83eb43b2-818b-4f42-8032-70afe3b20b09 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.574632 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83eb43b2-818b-4f42-8032-70afe3b20b09 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.574632 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83eb43b2-818b-4f42-8032-70afe3b20b09 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.606161 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-83eb43b2-818b-4f42-8032-70afe3b20b09 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046301 May 26 16:59:00.606648 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 331/680] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 16:59:00 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:00.703368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-18f8b13b-1f1a-43d3-b343-e04bb7ded426 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:00.704336 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-18f8b13b-1f1a-43d3-b343-e04bb7ded426 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:00.711023 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-18f8b13b-1f1a-43d3-b343-e04bb7ded426 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.711474 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-18f8b13b-1f1a-43d3-b343-e04bb7ded426 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.712248 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-18f8b13b-1f1a-43d3-b343-e04bb7ded426 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.712696 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-18f8b13b-1f1a-43d3-b343-e04bb7ded426 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.862754 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-18f8b13b-1f1a-43d3-b343-e04bb7ded426 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:00.870700 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-18f8b13b-1f1a-43d3-b343-e04bb7ded426 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1260 microversion: 2.1 time: 0.171596 May 26 16:59:00.871599 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 350/681] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:00 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:00.926705 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-adce7d1f-f378-4ad4-bc4f-452a01f58d89 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:00.927327 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-adce7d1f-f378-4ad4-bc4f-452a01f58d89 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:00.929312 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=20 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:00.934617 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-adce7d1f-f378-4ad4-bc4f-452a01f58d89 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.935217 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-adce7d1f-f378-4ad4-bc4f-452a01f58d89 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:00.936028 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-adce7d1f-f378-4ad4-bc4f-452a01f58d89 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:00.936452 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-adce7d1f-f378-4ad4-bc4f-452a01f58d89 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:01.078103 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-adce7d1f-f378-4ad4-bc4f-452a01f58d89 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:01.087297 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-adce7d1f-f378-4ad4-bc4f-452a01f58d89 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1671 microversion: 2.1 time: 0.165416 May 26 16:59:01.087926 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 332/682] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:00 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:01.492238 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-515ce4dc-43e2-4296-b767-8e30920df3e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:01.493031 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-515ce4dc-43e2-4296-b767-8e30920df3e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:01.504306 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-515ce4dc-43e2-4296-b767-8e30920df3e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:01.504751 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-515ce4dc-43e2-4296-b767-8e30920df3e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:01.505821 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-515ce4dc-43e2-4296-b767-8e30920df3e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:01.506271 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-515ce4dc-43e2-4296-b767-8e30920df3e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:01.618513 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ab8253bc-d68d-421c-bcc7-4009dd83f616 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:01.619459 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ab8253bc-d68d-421c-bcc7-4009dd83f616 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:01.626198 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ab8253bc-d68d-421c-bcc7-4009dd83f616 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:01.626657 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ab8253bc-d68d-421c-bcc7-4009dd83f616 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:01.628154 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ab8253bc-d68d-421c-bcc7-4009dd83f616 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:01.628604 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ab8253bc-d68d-421c-bcc7-4009dd83f616 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:01.640242 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-515ce4dc-43e2-4296-b767-8e30920df3e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:01.649443 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-515ce4dc-43e2-4296-b767-8e30920df3e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:01.650990 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-515ce4dc-43e2-4296-b767-8e30920df3e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:01.652114 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-515ce4dc-43e2-4296-b767-8e30920df3e8 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1405 microversion: 2.20 time: 0.165332 May 26 16:59:01.652764 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 351/683] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:59:01 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 16:59:01.660261 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ab8253bc-d68d-421c-bcc7-4009dd83f616 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045836 May 26 16:59:01.660823 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 333/684] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 16:59:01 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:59:01.891698 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2a821b78-b423-415d-825d-3590db387c04 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:01.893035 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2a821b78-b423-415d-825d-3590db387c04 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:01.901693 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2a821b78-b423-415d-825d-3590db387c04 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:01.902197 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2a821b78-b423-415d-825d-3590db387c04 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:01.903081 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2a821b78-b423-415d-825d-3590db387c04 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:01.903411 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2a821b78-b423-415d-825d-3590db387c04 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:02.043298 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2a821b78-b423-415d-825d-3590db387c04 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:02.050769 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2a821b78-b423-415d-825d-3590db387c04 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1260 microversion: 2.1 time: 0.164325 May 26 16:59:02.051328 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 352/685] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:01 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:02.105905 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6633e557-6a42-4b37-bf76-5e14b2a35883 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:02.106518 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6633e557-6a42-4b37-bf76-5e14b2a35883 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:02.112789 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6633e557-6a42-4b37-bf76-5e14b2a35883 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:02.113248 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6633e557-6a42-4b37-bf76-5e14b2a35883 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:02.114203 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6633e557-6a42-4b37-bf76-5e14b2a35883 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:02.114725 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6633e557-6a42-4b37-bf76-5e14b2a35883 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:02.253654 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6633e557-6a42-4b37-bf76-5e14b2a35883 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:02.261923 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6633e557-6a42-4b37-bf76-5e14b2a35883 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1671 microversion: 2.1 time: 0.160021 May 26 16:59:02.262497 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 334/686] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:02 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:02.670264 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2a8d4213-f528-44fb-9117-093f3fbb6d43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:02.671097 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2a8d4213-f528-44fb-9117-093f3fbb6d43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:02.672504 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1b3753fb-f113-4820-9933-b23fdf68fdc2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:02.674313 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1b3753fb-f113-4820-9933-b23fdf68fdc2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:02.678963 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2a8d4213-f528-44fb-9117-093f3fbb6d43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:02.679422 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2a8d4213-f528-44fb-9117-093f3fbb6d43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:02.680193 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2a8d4213-f528-44fb-9117-093f3fbb6d43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:02.680627 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2a8d4213-f528-44fb-9117-093f3fbb6d43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:02.681743 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b3753fb-f113-4820-9933-b23fdf68fdc2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:02.682315 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b3753fb-f113-4820-9933-b23fdf68fdc2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:02.683266 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b3753fb-f113-4820-9933-b23fdf68fdc2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:02.683843 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b3753fb-f113-4820-9933-b23fdf68fdc2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:02.711975 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:02.718086 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1b3753fb-f113-4820-9933-b23fdf68fdc2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049692 May 26 16:59:02.718666 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 335/687] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 16:59:02 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:59:02.825814 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2a8d4213-f528-44fb-9117-093f3fbb6d43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:02.834277 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2a8d4213-f528-44fb-9117-093f3fbb6d43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:02.835768 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2a8d4213-f528-44fb-9117-093f3fbb6d43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:02.836871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2a8d4213-f528-44fb-9117-093f3fbb6d43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1405 microversion: 2.20 time: 0.170701 May 26 16:59:02.837831 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 353/688] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:59:02 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:03.067976 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-62acb6c8-b66a-4ddb-b7df-2dee779a659c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:03.068617 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-62acb6c8-b66a-4ddb-b7df-2dee779a659c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:03.076478 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-62acb6c8-b66a-4ddb-b7df-2dee779a659c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:03.076933 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-62acb6c8-b66a-4ddb-b7df-2dee779a659c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:03.077746 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-62acb6c8-b66a-4ddb-b7df-2dee779a659c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:03.078164 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-62acb6c8-b66a-4ddb-b7df-2dee779a659c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:03.226558 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-62acb6c8-b66a-4ddb-b7df-2dee779a659c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:03.234901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-62acb6c8-b66a-4ddb-b7df-2dee779a659c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1260 microversion: 2.1 time: 0.171658 May 26 16:59:03.245179 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 336/689] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:03 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:03.280439 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7dc1e5c0-427b-46ef-9706-ec8e93d47349 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:03.281085 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7dc1e5c0-427b-46ef-9706-ec8e93d47349 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:03.288008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7dc1e5c0-427b-46ef-9706-ec8e93d47349 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:03.288460 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7dc1e5c0-427b-46ef-9706-ec8e93d47349 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:03.289225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7dc1e5c0-427b-46ef-9706-ec8e93d47349 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:03.289680 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7dc1e5c0-427b-46ef-9706-ec8e93d47349 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:03.441450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7dc1e5c0-427b-46ef-9706-ec8e93d47349 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:03.450525 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7dc1e5c0-427b-46ef-9706-ec8e93d47349 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1671 microversion: 2.1 time: 0.174478 May 26 16:59:03.451434 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 354/690] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:03 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:03.605603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-09a76d77-6902-41ec-beee-0b22093479e5 req-616a92ff-df0b-491f-afb7-76076507eace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ca388b-87f7-46b3-81f0-5e7d06e9dcc1", "name": "network-vif-plugged", "status": "completed", "tag": "17153ebf-8de6-4b1d-bafd-f2c2e8580998"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:03.614032 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-09a76d77-6902-41ec-beee-0b22093479e5 req-616a92ff-df0b-491f-afb7-76076507eace service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:03.614476 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-09a76d77-6902-41ec-beee-0b22093479e5 req-616a92ff-df0b-491f-afb7-76076507eace service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:03.627351 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-09a76d77-6902-41ec-beee-0b22093479e5 req-616a92ff-df0b-491f-afb7-76076507eace service nova] Creating event network-vif-plugged:17153ebf-8de6-4b1d-bafd-f2c2e8580998 for instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 on hv-cinder-83607 May 26 16:59:03.632430 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-09a76d77-6902-41ec-beee-0b22093479e5 req-616a92ff-df0b-491f-afb7-76076507eace service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088345 May 26 16:59:03.633252 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 337/691] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:03.730982 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-98156d84-8fc5-459c-99ef-952e6ea56154 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:03.732108 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-98156d84-8fc5-459c-99ef-952e6ea56154 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:03.745627 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-98156d84-8fc5-459c-99ef-952e6ea56154 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:03.746052 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-98156d84-8fc5-459c-99ef-952e6ea56154 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:03.746837 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-98156d84-8fc5-459c-99ef-952e6ea56154 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:03.747276 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-98156d84-8fc5-459c-99ef-952e6ea56154 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:03.787758 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-98156d84-8fc5-459c-99ef-952e6ea56154 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061064 May 26 16:59:03.788326 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 355/692] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 16:59:03 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 16:59:03.857190 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-95f71f6b-df45-42ec-804b-6455f7832249 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:03.857907 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-95f71f6b-df45-42ec-804b-6455f7832249 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:03.864528 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-95f71f6b-df45-42ec-804b-6455f7832249 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:03.865341 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-95f71f6b-df45-42ec-804b-6455f7832249 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:03.866434 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-95f71f6b-df45-42ec-804b-6455f7832249 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:03.866884 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-95f71f6b-df45-42ec-804b-6455f7832249 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:03.878564 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-47c10f78-b29f-4496-bc4e-615b0e4d905f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:03.881246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-47c10f78-b29f-4496-bc4e-615b0e4d905f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:03.886718 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-47c10f78-b29f-4496-bc4e-615b0e4d905f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:03.887368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-47c10f78-b29f-4496-bc4e-615b0e4d905f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:03.888314 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-47c10f78-b29f-4496-bc4e-615b0e4d905f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:03.888914 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-47c10f78-b29f-4496-bc4e-615b0e4d905f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:03.915786 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:03.920599 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-47c10f78-b29f-4496-bc4e-615b0e4d905f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Going to try to terminate instance {{(pid=124836) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:59:04.037347 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-95f71f6b-df45-42ec-804b-6455f7832249 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:04.046617 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-95f71f6b-df45-42ec-804b-6455f7832249 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:04.048161 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-95f71f6b-df45-42ec-804b-6455f7832249 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:04.050091 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-95f71f6b-df45-42ec-804b-6455f7832249 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1405 microversion: 2.20 time: 0.198410 May 26 16:59:04.061685 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 338/693] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:59:03 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:04.080578 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-290c3a46-6666-4d6f-8774-8ad1692cf090 req-5009cd38-4fcd-41de-9dfe-cc688b977196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e432ca18-47de-4981-bc37-036d927a5c62", "name": "network-vif-deleted", "tag": "aa5bb9eb-d210-4c41-8ad7-80a9d91058a7"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:04.092650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-290c3a46-6666-4d6f-8774-8ad1692cf090 req-5009cd38-4fcd-41de-9dfe-cc688b977196 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:04.093484 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-290c3a46-6666-4d6f-8774-8ad1692cf090 req-5009cd38-4fcd-41de-9dfe-cc688b977196 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:04.114453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-290c3a46-6666-4d6f-8774-8ad1692cf090 req-5009cd38-4fcd-41de-9dfe-cc688b977196 service nova] Creating event network-vif-deleted:aa5bb9eb-d210-4c41-8ad7-80a9d91058a7 for instance e432ca18-47de-4981-bc37-036d927a5c62 on hv-cinder-83607 May 26 16:59:04.120929 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-290c3a46-6666-4d6f-8774-8ad1692cf090 req-5009cd38-4fcd-41de-9dfe-cc688b977196 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056376 May 26 16:59:04.121844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 339/694] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:04.253410 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e7117699-afae-4b5e-b5b1-37ecb61c2b36 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:04.254121 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e7117699-afae-4b5e-b5b1-37ecb61c2b36 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:04.260787 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7117699-afae-4b5e-b5b1-37ecb61c2b36 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:04.263534 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7117699-afae-4b5e-b5b1-37ecb61c2b36 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:04.263534 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7117699-afae-4b5e-b5b1-37ecb61c2b36 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:04.263534 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e7117699-afae-4b5e-b5b1-37ecb61c2b36 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:04.351303 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-47c10f78-b29f-4496-bc4e-615b0e4d905f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 204 len: 0 microversion: 2.1 time: 0.479389 May 26 16:59:04.351983 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 356/695] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 16:59:03 2022] DELETE /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 16:59:04.360637 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9b5dc7b2-42fd-4ad6-ba30-3d74214906dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:04.361604 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9b5dc7b2-42fd-4ad6-ba30-3d74214906dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:04.368510 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b5dc7b2-42fd-4ad6-ba30-3d74214906dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:04.369147 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b5dc7b2-42fd-4ad6-ba30-3d74214906dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:04.370061 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b5dc7b2-42fd-4ad6-ba30-3d74214906dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:04.370608 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b5dc7b2-42fd-4ad6-ba30-3d74214906dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:04.404047 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e7117699-afae-4b5e-b5b1-37ecb61c2b36 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:04.414109 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e7117699-afae-4b5e-b5b1-37ecb61c2b36 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1260 microversion: 2.1 time: 0.165776 May 26 16:59:04.415019 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 340/696] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:04 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:59:04.468460 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-38715992-5ffc-41a4-a64d-42ee8f3f0ac2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:04.468996 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-38715992-5ffc-41a4-a64d-42ee8f3f0ac2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:04.476404 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38715992-5ffc-41a4-a64d-42ee8f3f0ac2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:04.476858 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38715992-5ffc-41a4-a64d-42ee8f3f0ac2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:04.477678 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38715992-5ffc-41a4-a64d-42ee8f3f0ac2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:04.478117 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38715992-5ffc-41a4-a64d-42ee8f3f0ac2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:04.511179 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9b5dc7b2-42fd-4ad6-ba30-3d74214906dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:04.520136 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9b5dc7b2-42fd-4ad6-ba30-3d74214906dd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1691 microversion: 2.1 time: 0.163733 May 26 16:59:04.521335 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 357/697] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:04 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:59:04.551011 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-38715992-5ffc-41a4-a64d-42ee8f3f0ac2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:04.559105 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-38715992-5ffc-41a4-a64d-42ee8f3f0ac2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1321 microversion: 2.1 time: 0.094784 May 26 16:59:04.560051 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 341/698] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:04 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1321 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:05.069026 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4a16ae86-99bf-46ab-8f38-82529eb63544 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:05.069720 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4a16ae86-99bf-46ab-8f38-82529eb63544 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:05.076978 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4a16ae86-99bf-46ab-8f38-82529eb63544 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.077693 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4a16ae86-99bf-46ab-8f38-82529eb63544 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.078679 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4a16ae86-99bf-46ab-8f38-82529eb63544 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.079122 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4a16ae86-99bf-46ab-8f38-82529eb63544 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.219627 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4a16ae86-99bf-46ab-8f38-82529eb63544 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:05.233400 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4a16ae86-99bf-46ab-8f38-82529eb63544 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:05.234988 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4a16ae86-99bf-46ab-8f38-82529eb63544 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:05.236783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4a16ae86-99bf-46ab-8f38-82529eb63544 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1405 microversion: 2.20 time: 0.172112 May 26 16:59:05.237378 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 358/699] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:59:05 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:05.431340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d01b5767-4586-4b95-86c0-e894e4370f95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:05.431987 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d01b5767-4586-4b95-86c0-e894e4370f95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:05.438658 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d01b5767-4586-4b95-86c0-e894e4370f95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.439112 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d01b5767-4586-4b95-86c0-e894e4370f95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.439887 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d01b5767-4586-4b95-86c0-e894e4370f95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.440331 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d01b5767-4586-4b95-86c0-e894e4370f95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.538504 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e280370d-3231-490d-8817-bff9fa30100b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:05.539113 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e280370d-3231-490d-8817-bff9fa30100b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:05.545344 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e280370d-3231-490d-8817-bff9fa30100b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.545800 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e280370d-3231-490d-8817-bff9fa30100b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.546569 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e280370d-3231-490d-8817-bff9fa30100b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.547002 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e280370d-3231-490d-8817-bff9fa30100b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.579152 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d01b5767-4586-4b95-86c0-e894e4370f95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:05.587456 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d01b5767-4586-4b95-86c0-e894e4370f95 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1260 microversion: 2.1 time: 0.159882 May 26 16:59:05.587960 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 342/700] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:05 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:05.592812 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-01667400-60bc-424d-94dc-cec1f7081bc4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:05.593456 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-01667400-60bc-424d-94dc-cec1f7081bc4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:05.600406 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-01667400-60bc-424d-94dc-cec1f7081bc4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.600859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-01667400-60bc-424d-94dc-cec1f7081bc4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.601660 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-01667400-60bc-424d-94dc-cec1f7081bc4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.602103 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-01667400-60bc-424d-94dc-cec1f7081bc4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.632349 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-01667400-60bc-424d-94dc-cec1f7081bc4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:05.632801 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-01667400-60bc-424d-94dc-cec1f7081bc4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:05.633249 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-01667400-60bc-424d-94dc-cec1f7081bc4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lazy-loading 'fault' on Instance uuid e432ca18-47de-4981-bc37-036d927a5c62 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:59:05.689072 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-01667400-60bc-424d-94dc-cec1f7081bc4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:05.708864 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e280370d-3231-490d-8817-bff9fa30100b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:05.709021 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-01667400-60bc-424d-94dc-cec1f7081bc4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1326 microversion: 2.1 time: 0.112039 May 26 16:59:05.709021 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 343/701] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:05 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1326 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:05.712618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e280370d-3231-490d-8817-bff9fa30100b tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1691 microversion: 2.1 time: 0.177942 May 26 16:59:05.713189 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 359/702] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:05 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1691 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:59:06.254601 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2050151e-c5cf-4cb2-b784-e5906b9256d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:06.255233 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2050151e-c5cf-4cb2-b784-e5906b9256d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:06.261361 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2050151e-c5cf-4cb2-b784-e5906b9256d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:06.261805 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2050151e-c5cf-4cb2-b784-e5906b9256d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:06.262558 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2050151e-c5cf-4cb2-b784-e5906b9256d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:06.262992 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2050151e-c5cf-4cb2-b784-e5906b9256d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:06.396377 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2050151e-c5cf-4cb2-b784-e5906b9256d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:06.404626 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2050151e-c5cf-4cb2-b784-e5906b9256d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:06.406445 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2050151e-c5cf-4cb2-b784-e5906b9256d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:06.407199 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2050151e-c5cf-4cb2-b784-e5906b9256d6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1405 microversion: 2.20 time: 0.156666 May 26 16:59:06.407797 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 344/703] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:59:06 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:06.604228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f76f6a10-7e05-4e95-b849-b2ba0c5547da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:06.604824 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f76f6a10-7e05-4e95-b849-b2ba0c5547da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:06.611475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f76f6a10-7e05-4e95-b849-b2ba0c5547da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:06.611928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f76f6a10-7e05-4e95-b849-b2ba0c5547da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:06.612695 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f76f6a10-7e05-4e95-b849-b2ba0c5547da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:06.613131 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f76f6a10-7e05-4e95-b849-b2ba0c5547da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:06.722738 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f11389ee-4fe8-4860-b2aa-9ee12a46d0f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:06.723391 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f11389ee-4fe8-4860-b2aa-9ee12a46d0f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:06.730092 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f11389ee-4fe8-4860-b2aa-9ee12a46d0f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:06.730537 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f11389ee-4fe8-4860-b2aa-9ee12a46d0f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:06.731294 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f11389ee-4fe8-4860-b2aa-9ee12a46d0f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:06.731727 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f11389ee-4fe8-4860-b2aa-9ee12a46d0f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:06.744397 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f76f6a10-7e05-4e95-b849-b2ba0c5547da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:06.752677 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f76f6a10-7e05-4e95-b849-b2ba0c5547da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1260 microversion: 2.1 time: 0.152257 May 26 16:59:06.753277 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 360/704] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:06 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:06.766576 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-dcc1c1bf-6e29-4505-bf10-c469d88b07d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:06.766576 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-dcc1c1bf-6e29-4505-bf10-c469d88b07d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:06.766576 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dcc1c1bf-6e29-4505-bf10-c469d88b07d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:06.766885 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f11389ee-4fe8-4860-b2aa-9ee12a46d0f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:06.766974 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dcc1c1bf-6e29-4505-bf10-c469d88b07d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:06.767062 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f11389ee-4fe8-4860-b2aa-9ee12a46d0f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:06.767062 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-f11389ee-4fe8-4860-b2aa-9ee12a46d0f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lazy-loading 'fault' on Instance uuid e432ca18-47de-4981-bc37-036d927a5c62 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:59:06.767398 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dcc1c1bf-6e29-4505-bf10-c469d88b07d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:06.767398 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dcc1c1bf-6e29-4505-bf10-c469d88b07d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:06.809764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f11389ee-4fe8-4860-b2aa-9ee12a46d0f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:06.818049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f11389ee-4fe8-4860-b2aa-9ee12a46d0f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1326 microversion: 2.1 time: 0.099118 May 26 16:59:06.818636 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 345/705] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:06 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:59:06.911747 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-dcc1c1bf-6e29-4505-bf10-c469d88b07d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:06.919599 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-dcc1c1bf-6e29-4505-bf10-c469d88b07d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1691 microversion: 2.1 time: 0.165330 May 26 16:59:06.920346 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 361/706] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:06 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:07.378025 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-53643877-f907-48de-8b72-7fe1830646b7 req-aa1944a1-987c-4c0e-87dc-feccc19cd38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b981b012-8995-4185-9b5c-03934263a18c", "name": "network-vif-plugged", "status": "completed", "tag": "dd6991b4-2331-41f4-a211-234d1b499987"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:07.386087 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-53643877-f907-48de-8b72-7fe1830646b7 req-aa1944a1-987c-4c0e-87dc-feccc19cd38f service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:07.386533 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-53643877-f907-48de-8b72-7fe1830646b7 req-aa1944a1-987c-4c0e-87dc-feccc19cd38f service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:07.398019 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-53643877-f907-48de-8b72-7fe1830646b7 req-aa1944a1-987c-4c0e-87dc-feccc19cd38f service nova] Creating event network-vif-plugged:dd6991b4-2331-41f4-a211-234d1b499987 for instance b981b012-8995-4185-9b5c-03934263a18c on hv-cinder-83607 May 26 16:59:07.402796 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-53643877-f907-48de-8b72-7fe1830646b7 req-aa1944a1-987c-4c0e-87dc-feccc19cd38f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029006 May 26 16:59:07.403371 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 346/707] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:07.426569 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5d71a341-2885-4854-974c-ca56b4804cc3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:07.427184 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5d71a341-2885-4854-974c-ca56b4804cc3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:07.433654 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d71a341-2885-4854-974c-ca56b4804cc3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:07.434112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d71a341-2885-4854-974c-ca56b4804cc3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:07.434882 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d71a341-2885-4854-974c-ca56b4804cc3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:07.435329 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d71a341-2885-4854-974c-ca56b4804cc3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:07.571840 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5d71a341-2885-4854-974c-ca56b4804cc3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:07.580444 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5d71a341-2885-4854-974c-ca56b4804cc3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:07.582052 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5d71a341-2885-4854-974c-ca56b4804cc3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:07.583178 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5d71a341-2885-4854-974c-ca56b4804cc3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1405 microversion: 2.20 time: 0.160856 May 26 16:59:07.583740 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 362/708] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:59:07 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:07.783492 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-58dc57e2-b481-4f99-9bb8-7d7e785626db tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:07.784198 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-58dc57e2-b481-4f99-9bb8-7d7e785626db tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:07.790549 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58dc57e2-b481-4f99-9bb8-7d7e785626db tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:07.791005 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58dc57e2-b481-4f99-9bb8-7d7e785626db tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:07.791772 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58dc57e2-b481-4f99-9bb8-7d7e785626db tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:07.792213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-58dc57e2-b481-4f99-9bb8-7d7e785626db tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:07.835157 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-767268d7-15d2-4aae-9f81-b45bfb3c2afa tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:07.836828 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-767268d7-15d2-4aae-9f81-b45bfb3c2afa tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:07.843617 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-767268d7-15d2-4aae-9f81-b45bfb3c2afa tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:07.844076 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-767268d7-15d2-4aae-9f81-b45bfb3c2afa tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:07.844857 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-767268d7-15d2-4aae-9f81-b45bfb3c2afa tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:07.845330 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-767268d7-15d2-4aae-9f81-b45bfb3c2afa tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:07.880403 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-767268d7-15d2-4aae-9f81-b45bfb3c2afa tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:07.880849 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-767268d7-15d2-4aae-9f81-b45bfb3c2afa tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:07.881323 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-767268d7-15d2-4aae-9f81-b45bfb3c2afa tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lazy-loading 'fault' on Instance uuid e432ca18-47de-4981-bc37-036d927a5c62 {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:59:07.942898 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-767268d7-15d2-4aae-9f81-b45bfb3c2afa tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:07.950294 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-767268d7-15d2-4aae-9f81-b45bfb3c2afa tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1326 microversion: 2.1 time: 0.119215 May 26 16:59:07.950864 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 363/709] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:07 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1326 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:07.962722 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-58dc57e2-b481-4f99-9bb8-7d7e785626db tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:07.963204 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-d2b95980-a2f6-49de-a75d-4a211485c9d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:07.963816 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-d2b95980-a2f6-49de-a75d-4a211485c9d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:07.969766 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d2b95980-a2f6-49de-a75d-4a211485c9d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:07.970215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d2b95980-a2f6-49de-a75d-4a211485c9d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:07.970977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d2b95980-a2f6-49de-a75d-4a211485c9d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:07.971119 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-58dc57e2-b481-4f99-9bb8-7d7e785626db tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1260 microversion: 2.1 time: 0.192194 May 26 16:59:07.971413 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d2b95980-a2f6-49de-a75d-4a211485c9d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:07.972404 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 347/710] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:07 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:08.105055 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d2b95980-a2f6-49de-a75d-4a211485c9d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:08.113062 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-d2b95980-a2f6-49de-a75d-4a211485c9d4 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1691 microversion: 2.1 time: 0.161257 May 26 16:59:08.113652 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 364/711] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:07 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:08.602422 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d0164411-3f91-4cc8-9cdc-97ae2950fd72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:08.603169 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d0164411-3f91-4cc8-9cdc-97ae2950fd72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:08.609354 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0164411-3f91-4cc8-9cdc-97ae2950fd72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:08.609807 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0164411-3f91-4cc8-9cdc-97ae2950fd72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:08.610581 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0164411-3f91-4cc8-9cdc-97ae2950fd72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:08.611037 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d0164411-3f91-4cc8-9cdc-97ae2950fd72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:08.743273 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d0164411-3f91-4cc8-9cdc-97ae2950fd72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:08.751457 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d0164411-3f91-4cc8-9cdc-97ae2950fd72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:08.753763 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d0164411-3f91-4cc8-9cdc-97ae2950fd72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:08.758468 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d0164411-3f91-4cc8-9cdc-97ae2950fd72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1597 microversion: 2.20 time: 0.156774 May 26 16:59:08.758468 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 348/712] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:59:08 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1597 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:08.773112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-58cf057f-f464-4819-9d83-e24018cbd704 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:08.773638 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-58cf057f-f464-4819-9d83-e24018cbd704 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:08.779843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-58cf057f-f464-4819-9d83-e24018cbd704 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:08.780298 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-58cf057f-f464-4819-9d83-e24018cbd704 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:08.781107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-58cf057f-f464-4819-9d83-e24018cbd704 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:08.781582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-58cf057f-f464-4819-9d83-e24018cbd704 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:08.863608 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-58cf057f-f464-4819-9d83-e24018cbd704 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094465 May 26 16:59:08.864374 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 365/713] 10.222.0.48 () {60 vars in 1315 bytes} [Thu May 26 16:59:08 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:59:08.966496 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7fad56f0-f2dd-4c23-aa32-40947798840b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:08.967200 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7fad56f0-f2dd-4c23-aa32-40947798840b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:08.974266 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7fad56f0-f2dd-4c23-aa32-40947798840b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:08.974721 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7fad56f0-f2dd-4c23-aa32-40947798840b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:08.975485 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7fad56f0-f2dd-4c23-aa32-40947798840b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:08.975916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7fad56f0-f2dd-4c23-aa32-40947798840b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:08.988630 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a2010358-a013-4ba2-9a6c-f5bc13dfb945 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:08.989374 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a2010358-a013-4ba2-9a6c-f5bc13dfb945 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:08.998545 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a2010358-a013-4ba2-9a6c-f5bc13dfb945 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:08.999024 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a2010358-a013-4ba2-9a6c-f5bc13dfb945 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:08.999823 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a2010358-a013-4ba2-9a6c-f5bc13dfb945 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:09.000259 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a2010358-a013-4ba2-9a6c-f5bc13dfb945 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:09.017151 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7fad56f0-f2dd-4c23-aa32-40947798840b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:09.017686 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7fad56f0-f2dd-4c23-aa32-40947798840b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:09.018169 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-7fad56f0-f2dd-4c23-aa32-40947798840b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lazy-loading 'fault' on Instance uuid e432ca18-47de-4981-bc37-036d927a5c62 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:59:09.128631 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7fad56f0-f2dd-4c23-aa32-40947798840b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:09.136381 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7fad56f0-f2dd-4c23-aa32-40947798840b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 200 len: 1326 microversion: 2.1 time: 0.173700 May 26 16:59:09.137495 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 349/714] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:08 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 1326 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:09.141873 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fad330dc-ab1a-44e1-9e29-eaf057bcdfdf tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:09.142692 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fad330dc-ab1a-44e1-9e29-eaf057bcdfdf tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:09.149029 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fad330dc-ab1a-44e1-9e29-eaf057bcdfdf tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:09.149553 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fad330dc-ab1a-44e1-9e29-eaf057bcdfdf tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:09.150336 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fad330dc-ab1a-44e1-9e29-eaf057bcdfdf tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:09.150970 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fad330dc-ab1a-44e1-9e29-eaf057bcdfdf tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:09.314533 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a2010358-a013-4ba2-9a6c-f5bc13dfb945 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:09.322480 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a2010358-a013-4ba2-9a6c-f5bc13dfb945 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1260 microversion: 2.1 time: 0.338391 May 26 16:59:09.323233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 366/715] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:08 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1260 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:59:09.412233 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-fad330dc-ab1a-44e1-9e29-eaf057bcdfdf tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:09.419983 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fad330dc-ab1a-44e1-9e29-eaf057bcdfdf tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1691 microversion: 2.1 time: 0.281684 May 26 16:59:09.420560 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 350/716] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:09 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1691 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:10.154119 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f8c8f7db-ea8b-4de6-a87a-74e59b5b2b66 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:10.155027 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f8c8f7db-ea8b-4de6-a87a-74e59b5b2b66 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:10.163250 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f8c8f7db-ea8b-4de6-a87a-74e59b5b2b66 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:10.163856 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f8c8f7db-ea8b-4de6-a87a-74e59b5b2b66 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:10.164753 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f8c8f7db-ea8b-4de6-a87a-74e59b5b2b66 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:10.165393 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f8c8f7db-ea8b-4de6-a87a-74e59b5b2b66 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:10.181646 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-f8c8f7db-ea8b-4de6-a87a-74e59b5b2b66 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] HTTP exception thrown: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f8c8f7db-ea8b-4de6-a87a-74e59b5b2b66 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Request method failure captured: May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 HTTP/1.1 May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7CM4fldsHDPgaRLTByjN4M_RTZa9UrovvQY7c9sUtwKdbMkDUvbFos_HFvNUmjAZIlQj0sT963_vZ0gwTkb1eub2bQ8hyZzwwP6YAfWsit3x-0xEiocaTtHPSAbAE4k9J_x81wGbCNE5wvKAy4HUwwmLGer77t-ZBE04EYNVOHozzc May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 89a7299f01984027a505aa43d96e07b3 May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeTestJSON-378673516 May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:59:10.183591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:59:10.185232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89a7299f01984027a505aa43d96e07b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89a7299f01984027a505aa43d96e07b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_89a7299f01984027a505aa43d96e07b3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/89a7299f01984027a505aa43d96e07b3"}]}] May 26 16:59:10.185232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeTestJSON-378673516 May 26 16:59:10.185232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 89a7299f01984027a505aa43d96e07b3 May 26 16:59:10.185232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeTestJSON-378673516 May 26 16:59:10.185232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeTestJSON-378673516-project May 26 16:59:10.185232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:59:10.185232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:59:10.185232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: d5684eb0dd3141f5a25b61aafedbe865 May 26 16:59:10.185232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeTestJSON-378673516-project May 26 16:59:10.185232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 16:59:10.185232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. May 26 16:59:10.185232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': 'e432ca18-47de-4981-bc37-036d927a5c62'} May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:59:10.186275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. May 26 16:59:10.187796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:59:10.189487 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f8c8f7db-ea8b-4de6-a87a-74e59b5b2b66 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Returning 404 to user: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:59:10.190307 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f8c8f7db-ea8b-4de6-a87a-74e59b5b2b66 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 404 len: 111 microversion: 2.1 time: 0.039871 May 26 16:59:10.190992 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 367/717] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:10 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:59:10.200759 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-521775f8-bed1-4ead-b6cf-f2f628c85dfb tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '.version_select at 0x7fbe803c5280>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:10.336276 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-521775f8-bed1-4ead-b6cf-f2f628c85dfb tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-955371537" status: 202 len: 0 microversion: 2.1 time: 0.140199 May 26 16:59:10.337114 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 351/718] 10.222.0.48 () {58 vars in 1217 bytes} [Thu May 26 16:59:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-955371537 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:59:10.340171 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-707e2799-df26-4dfe-a51e-a48beb2dd490 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:10.341158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-707e2799-df26-4dfe-a51e-a48beb2dd490 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:10.348000 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-707e2799-df26-4dfe-a51e-a48beb2dd490 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:10.348449 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-707e2799-df26-4dfe-a51e-a48beb2dd490 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:10.349522 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-707e2799-df26-4dfe-a51e-a48beb2dd490 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:10.349960 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-707e2799-df26-4dfe-a51e-a48beb2dd490 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:10.441665 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e047b995-dd19-4468-970e-b8eed032fdc8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:10.442329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e047b995-dd19-4468-970e-b8eed032fdc8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:10.450931 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e047b995-dd19-4468-970e-b8eed032fdc8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:10.451655 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e047b995-dd19-4468-970e-b8eed032fdc8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:10.453508 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e047b995-dd19-4468-970e-b8eed032fdc8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:10.454144 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e047b995-dd19-4468-970e-b8eed032fdc8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:10.535142 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e047b995-dd19-4468-970e-b8eed032fdc8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:10.549006 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e047b995-dd19-4468-970e-b8eed032fdc8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1624 microversion: 2.1 time: 0.114666 May 26 16:59:10.550224 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 352/719] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:10 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1624 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:10.555291 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-153b67a4-a4cd-4467-9c92-f0b7d0d46664 req-840c7a71-2657-4c94-9dda-e4b74a5a7512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ca388b-87f7-46b3-81f0-5e7d06e9dcc1", "tag": "17153ebf-8de6-4b1d-bafd-f2c2e8580998"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:10.570092 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-153b67a4-a4cd-4467-9c92-f0b7d0d46664 req-840c7a71-2657-4c94-9dda-e4b74a5a7512 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:10.570856 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-153b67a4-a4cd-4467-9c92-f0b7d0d46664 req-840c7a71-2657-4c94-9dda-e4b74a5a7512 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:10.583466 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-153b67a4-a4cd-4467-9c92-f0b7d0d46664 req-840c7a71-2657-4c94-9dda-e4b74a5a7512 service nova] Creating event network-changed:17153ebf-8de6-4b1d-bafd-f2c2e8580998 for instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 on hv-cinder-83607 May 26 16:59:10.595124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-153b67a4-a4cd-4467-9c92-f0b7d0d46664 req-840c7a71-2657-4c94-9dda-e4b74a5a7512 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043437 May 26 16:59:10.596306 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 353/720] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:10.647407 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-707e2799-df26-4dfe-a51e-a48beb2dd490 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:10.661730 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-707e2799-df26-4dfe-a51e-a48beb2dd490 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1260 microversion: 2.1 time: 0.325463 May 26 16:59:10.663422 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 368/721] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:10 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1260 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:59:11.212923 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-c4040fd4-b34b-4644-af30-e5b8dda3686d req-a4744f30-3342-4a00-a298-002a83281121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8efc5100-c116-4608-a1d9-26e418e0609e", "name": "network-vif-deleted", "tag": "3477b3a3-f453-4aca-9e4e-a3d0795c1473"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:11.228696 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-c4040fd4-b34b-4644-af30-e5b8dda3686d req-a4744f30-3342-4a00-a298-002a83281121 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:11.232165 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-c4040fd4-b34b-4644-af30-e5b8dda3686d req-a4744f30-3342-4a00-a298-002a83281121 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:11.252477 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-c4040fd4-b34b-4644-af30-e5b8dda3686d req-a4744f30-3342-4a00-a298-002a83281121 service nova] Creating event network-vif-deleted:3477b3a3-f453-4aca-9e4e-a3d0795c1473 for instance 8efc5100-c116-4608-a1d9-26e418e0609e on hv-cinder-83607 May 26 16:59:11.258133 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-c4040fd4-b34b-4644-af30-e5b8dda3686d req-a4744f30-3342-4a00-a298-002a83281121 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049922 May 26 16:59:11.259090 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 354/722] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:11.544627 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6edf0ee8-4261-4cd2-82c2-ac753fad2b60 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Action: 'create', calling method: .version_select at 0x7fbe80524d30>, body: {"keypair": {"name": "tempest-keypair-88562116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDY/sVJQTBW/99JEAVdpio09PqxDeqg8/6iLhgyFTHtb9lnQDn780GympPb/sRadwXV12y146QSnnLucMWnmHwnWkNrwUb2OdyuvdNpVbP9hcycBKLSUZhR1QTW0L/E01A=="}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:11.561726 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-6edf0ee8-4261-4cd2-82c2-ac753fad2b60 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Getting quotas for project 89a7299f01984027a505aa43d96e07b3. Resources: {'key_pairs'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:59:11.568128 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-159afdb1-c9ce-44b8-9546-ab88bb578ca7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:11.568826 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-159afdb1-c9ce-44b8-9546-ab88bb578ca7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:11.575552 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-159afdb1-c9ce-44b8-9546-ab88bb578ca7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:11.576001 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-159afdb1-c9ce-44b8-9546-ab88bb578ca7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:11.576773 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-159afdb1-c9ce-44b8-9546-ab88bb578ca7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:11.577206 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-159afdb1-c9ce-44b8-9546-ab88bb578ca7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:11.585891 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-6edf0ee8-4261-4cd2-82c2-ac753fad2b60 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Getting quotas for user d5684eb0dd3141f5a25b61aafedbe865 and project 89a7299f01984027a505aa43d96e07b3. Resources: {'key_pairs'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:59:11.676080 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-159afdb1-c9ce-44b8-9546-ab88bb578ca7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:11.678656 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:11.685850 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-159afdb1-c9ce-44b8-9546-ab88bb578ca7 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1624 microversion: 2.1 time: 0.121741 May 26 16:59:11.686803 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 355/723] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:11 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1624 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:11.693673 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-874c06e6-eb7e-4b18-94a0-070aaef21e6e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:11.694820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-874c06e6-eb7e-4b18-94a0-070aaef21e6e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:11.698376 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6edf0ee8-4261-4cd2-82c2-ac753fad2b60 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.157704 May 26 16:59:11.702312 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 369/724] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 26 16:59:11 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:11.702707 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-874c06e6-eb7e-4b18-94a0-070aaef21e6e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:11.703546 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-874c06e6-eb7e-4b18-94a0-070aaef21e6e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:11.705218 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-874c06e6-eb7e-4b18-94a0-070aaef21e6e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:11.705892 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-874c06e6-eb7e-4b18-94a0-070aaef21e6e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:12.174260 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-874c06e6-eb7e-4b18-94a0-070aaef21e6e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:12.182510 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-874c06e6-eb7e-4b18-94a0-070aaef21e6e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1445 microversion: 2.1 time: 0.494394 May 26 16:59:12.183119 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 356/725] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:11 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1445 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:12.199708 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8bdbd3f9-cb0a-4812-a5c4-2fe3a9f7da7e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:12.200336 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8bdbd3f9-cb0a-4812-a5c4-2fe3a9f7da7e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:12.207789 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8bdbd3f9-cb0a-4812-a5c4-2fe3a9f7da7e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:12.208488 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8bdbd3f9-cb0a-4812-a5c4-2fe3a9f7da7e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:12.209414 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8bdbd3f9-cb0a-4812-a5c4-2fe3a9f7da7e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:12.210088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8bdbd3f9-cb0a-4812-a5c4-2fe3a9f7da7e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:12.370157 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8bdbd3f9-cb0a-4812-a5c4-2fe3a9f7da7e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:12.379980 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8bdbd3f9-cb0a-4812-a5c4-2fe3a9f7da7e tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1445 microversion: 2.1 time: 0.184067 May 26 16:59:12.380610 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 370/726] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:12 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1445 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:12.703734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a0459ca5-6fba-45ff-897d-51a2512106b8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:12.704414 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a0459ca5-6fba-45ff-897d-51a2512106b8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:12.712341 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a0459ca5-6fba-45ff-897d-51a2512106b8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:12.712855 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a0459ca5-6fba-45ff-897d-51a2512106b8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:12.713668 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a0459ca5-6fba-45ff-897d-51a2512106b8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:12.714154 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a0459ca5-6fba-45ff-897d-51a2512106b8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:12.748681 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a0459ca5-6fba-45ff-897d-51a2512106b8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:12.749140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a0459ca5-6fba-45ff-897d-51a2512106b8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:12.749637 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-a0459ca5-6fba-45ff-897d-51a2512106b8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lazy-loading 'fault' on Instance uuid 8efc5100-c116-4608-a1d9-26e418e0609e {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:59:12.826241 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a0459ca5-6fba-45ff-897d-51a2512106b8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:12.836709 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a0459ca5-6fba-45ff-897d-51a2512106b8 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 200 len: 1336 microversion: 2.1 time: 0.137149 May 26 16:59:12.841020 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 357/727] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:12 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 1336 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:13.856354 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1522eaa1-12d4-40c2-8c97-8c505351abe1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:13.857444 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1522eaa1-12d4-40c2-8c97-8c505351abe1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 8efc5100-c116-4608-a1d9-26e418e0609e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:13.866227 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1522eaa1-12d4-40c2-8c97-8c505351abe1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:13.866850 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1522eaa1-12d4-40c2-8c97-8c505351abe1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:13.868118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1522eaa1-12d4-40c2-8c97-8c505351abe1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:13.868667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1522eaa1-12d4-40c2-8c97-8c505351abe1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:13.884745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-1522eaa1-12d4-40c2-8c97-8c505351abe1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] HTTP exception thrown: Instance 8efc5100-c116-4608-a1d9-26e418e0609e could not be found. May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1522eaa1-12d4-40c2-8c97-8c505351abe1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Request method failure captured: May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e HTTP/1.1 May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7CH0rRgnMIlqD063iAZ1ez0QCmlEZqp8QO5ZHjV6XSABZyVeCa3_rL4GukWUzmymH9jymZkR9aYr_V2RQaROCLGEkpNcCgSPyMdlFCJNjPh_1Ze5FLmietbK2CJnk7y7SKXRAka654COK9sD96s20UhiFkxqVLsn7TyJAFc87ArqJ8 May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 5150e5b054d34d09a3cb69e35f9c86dd May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1243169788 May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:59:13.886601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:59:13.888162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5150e5b054d34d09a3cb69e35f9c86dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5150e5b054d34d09a3cb69e35f9c86dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5150e5b054d34d09a3cb69e35f9c86dd", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5150e5b054d34d09a3cb69e35f9c86dd"}]}] May 26 16:59:13.888162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1243169788 May 26 16:59:13.888162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 5150e5b054d34d09a3cb69e35f9c86dd May 26 16:59:13.888162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1243169788 May 26 16:59:13.888162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-ServerRescueNegativeTestJSON-1243169788-project May 26 16:59:13.888162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:59:13.888162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:59:13.888162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 1cf5ba73296e41c4ab58a6a962b578d3 May 26 16:59:13.888162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1243169788-project May 26 16:59:13.888162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 16:59:13.888162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 8efc5100-c116-4608-a1d9-26e418e0609e could not be found. May 26 16:59:13.888162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '8efc5100-c116-4608-a1d9-26e418e0609e'} May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8efc5100-c116-4608-a1d9-26e418e0609e could not be found. May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:59:13.889042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8efc5100-c116-4608-a1d9-26e418e0609e could not be found. May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8efc5100-c116-4608-a1d9-26e418e0609e could not be found. May 26 16:59:13.890577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:59:13.891936 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1522eaa1-12d4-40c2-8c97-8c505351abe1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Returning 404 to user: Instance 8efc5100-c116-4608-a1d9-26e418e0609e could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:59:13.892387 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-1522eaa1-12d4-40c2-8c97-8c505351abe1 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e" status: 404 len: 111 microversion: 2.1 time: 0.039745 May 26 16:59:13.893473 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 371/728] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:13 2022] GET /compute/v2.1/servers/8efc5100-c116-4608-a1d9-26e418e0609e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:59:13.901874 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9d9bc08d-cd23-4405-8814-452b099b90b9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '.version_select at 0x7fbe80381b80>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:13.980878 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9d9bc08d-cd23-4405-8814-452b099b90b9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1654103350" status: 202 len: 0 microversion: 2.1 time: 0.082760 May 26 16:59:13.981485 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 358/729] 10.222.0.48 () {58 vars in 1220 bytes} [Thu May 26 16:59:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1654103350 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 16:59:14.703966 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-210365739", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37da0019-c0ef-4a38-bc4c-338c9bba0a61"}], "security_groups": [{"name": "tempest-securitygroup--1802125920"}], "key_name": "tempest-keypair-88562116", "user_data": "}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:14.851628 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.network.neutron [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] validate_networks() for [('37da0019-c0ef-4a38-bc4c-338c9bba0a61', None, None, None, None, None)] {{(pid=124836) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 16:59:15.209824 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-1eb9aa72-5945-42a8-8747-1e57ae595f5e req-6cebdced-974c-40e4-9ab6-bdf227acab54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b981b012-8995-4185-9b5c-03934263a18c", "tag": "dd6991b4-2331-41f4-a211-234d1b499987"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:15.220235 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-1eb9aa72-5945-42a8-8747-1e57ae595f5e req-6cebdced-974c-40e4-9ab6-bdf227acab54 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:15.220670 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-1eb9aa72-5945-42a8-8747-1e57ae595f5e req-6cebdced-974c-40e4-9ab6-bdf227acab54 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:15.233336 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-1eb9aa72-5945-42a8-8747-1e57ae595f5e req-6cebdced-974c-40e4-9ab6-bdf227acab54 service nova] Creating event network-changed:dd6991b4-2331-41f4-a211-234d1b499987 for instance b981b012-8995-4185-9b5c-03934263a18c on hv-cinder-83607 May 26 16:59:15.240830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-1eb9aa72-5945-42a8-8747-1e57ae595f5e req-6cebdced-974c-40e4-9ab6-bdf227acab54 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035651 May 26 16:59:15.241549 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 359/730] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:15.632307 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Flavor limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 16:59:15.632863 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Image limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 16:59:15.633202 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Flavor pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 16:59:15.635426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Image pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 16:59:15.635426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 16:59:15.636277 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:15.646193 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:15.646727 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:15.647620 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:15.648067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:15.666660 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Getting quotas for project 89a7299f01984027a505aa43d96e07b3. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 16:59:15.671044 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Getting quotas for user d5684eb0dd3141f5a25b61aafedbe865 and project 89a7299f01984027a505aa43d96e07b3. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 16:59:15.684518 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Going to run 1 instances... {{(pid=124836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 16:59:15.687147 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 16:59:15.836573 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-24757d18-210a-4b9a-9ae3-d6cb53957df6 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.137121 May 26 16:59:15.844520 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 372/731] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 16:59:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 16:59:15.863040 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b5b7cb16-2e0a-4211-868f-88aec78448e1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:15.863040 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b5b7cb16-2e0a-4211-868f-88aec78448e1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:15.863040 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:15.927509 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b5b7cb16-2e0a-4211-868f-88aec78448e1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:15.934586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b5b7cb16-2e0a-4211-868f-88aec78448e1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1235 microversion: 2.1 time: 0.086411 May 26 16:59:15.935111 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 360/732] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:15 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1235 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:16.952857 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6f088765-9ab6-4ca1-88cb-d94df11dbd36 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:16.953651 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6f088765-9ab6-4ca1-88cb-d94df11dbd36 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:16.960175 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6f088765-9ab6-4ca1-88cb-d94df11dbd36 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:16.960631 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6f088765-9ab6-4ca1-88cb-d94df11dbd36 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:16.961417 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6f088765-9ab6-4ca1-88cb-d94df11dbd36 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:16.961860 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6f088765-9ab6-4ca1-88cb-d94df11dbd36 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:17.028170 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6f088765-9ab6-4ca1-88cb-d94df11dbd36 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:17.038122 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6f088765-9ab6-4ca1-88cb-d94df11dbd36 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1239 microversion: 2.1 time: 0.090000 May 26 16:59:17.038720 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 373/733] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:16 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1239 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:17.866678 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bc55005f-c363-44bd-b018-0ab842f24104 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:17.867179 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bc55005f-c363-44bd-b018-0ab842f24104 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:17.874598 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bc55005f-c363-44bd-b018-0ab842f24104 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:17.875061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bc55005f-c363-44bd-b018-0ab842f24104 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:17.875839 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bc55005f-c363-44bd-b018-0ab842f24104 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:17.876767 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bc55005f-c363-44bd-b018-0ab842f24104 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:17.903320 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bc55005f-c363-44bd-b018-0ab842f24104 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:59:18.055599 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-0c5f7f3f-223e-4e5f-8e4a-c18df26cd47d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:18.056311 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-0c5f7f3f-223e-4e5f-8e4a-c18df26cd47d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:18.063271 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0c5f7f3f-223e-4e5f-8e4a-c18df26cd47d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:18.063726 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0c5f7f3f-223e-4e5f-8e4a-c18df26cd47d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:18.065009 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0c5f7f3f-223e-4e5f-8e4a-c18df26cd47d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:18.065484 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-0c5f7f3f-223e-4e5f-8e4a-c18df26cd47d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:18.087473 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:18.136065 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-0c5f7f3f-223e-4e5f-8e4a-c18df26cd47d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:18.144444 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-0c5f7f3f-223e-4e5f-8e4a-c18df26cd47d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1287 microversion: 2.1 time: 0.092756 May 26 16:59:18.145035 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 374/734] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:18 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:59:18.231457 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bc55005f-c363-44bd-b018-0ab842f24104 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "DELETE /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 204 len: 0 microversion: 2.1 time: 0.368438 May 26 16:59:18.232144 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 361/735] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 16:59:17 2022] DELETE /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:59:18.242515 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a26ceaf8-b87f-439f-b4bd-123b9be4c52f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:18.243158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a26ceaf8-b87f-439f-b4bd-123b9be4c52f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:18.250046 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a26ceaf8-b87f-439f-b4bd-123b9be4c52f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:18.251201 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a26ceaf8-b87f-439f-b4bd-123b9be4c52f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:18.252620 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a26ceaf8-b87f-439f-b4bd-123b9be4c52f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:18.253063 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a26ceaf8-b87f-439f-b4bd-123b9be4c52f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:18.388723 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a26ceaf8-b87f-439f-b4bd-123b9be4c52f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:18.398466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a26ceaf8-b87f-439f-b4bd-123b9be4c52f tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1508 microversion: 2.1 time: 0.161824 May 26 16:59:18.403175 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 375/736] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:18 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:19.170580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-603cdeef-aa39-4d9b-9d28-bfd3b996a3d9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:19.171278 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-603cdeef-aa39-4d9b-9d28-bfd3b996a3d9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:19.177961 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-603cdeef-aa39-4d9b-9d28-bfd3b996a3d9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:19.178485 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-603cdeef-aa39-4d9b-9d28-bfd3b996a3d9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:19.179166 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-603cdeef-aa39-4d9b-9d28-bfd3b996a3d9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:19.179608 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-603cdeef-aa39-4d9b-9d28-bfd3b996a3d9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:19.242546 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-603cdeef-aa39-4d9b-9d28-bfd3b996a3d9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:19.250121 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-603cdeef-aa39-4d9b-9d28-bfd3b996a3d9 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1295 microversion: 2.1 time: 0.083772 May 26 16:59:19.250691 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 362/737] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:19 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:19.416045 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e6c0c919-e2dd-463b-8168-ef8aa6ec46d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:19.416589 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e6c0c919-e2dd-463b-8168-ef8aa6ec46d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:19.423758 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e6c0c919-e2dd-463b-8168-ef8aa6ec46d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:19.424207 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e6c0c919-e2dd-463b-8168-ef8aa6ec46d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:19.425010 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e6c0c919-e2dd-463b-8168-ef8aa6ec46d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:19.425483 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e6c0c919-e2dd-463b-8168-ef8aa6ec46d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:19.563025 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e6c0c919-e2dd-463b-8168-ef8aa6ec46d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:19.572711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e6c0c919-e2dd-463b-8168-ef8aa6ec46d9 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1508 microversion: 2.1 time: 0.160510 May 26 16:59:19.573743 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 376/738] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:19 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:20.268066 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-87f7abb1-3be2-4715-bc37-27e8f8adfd0a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:20.268744 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-87f7abb1-3be2-4715-bc37-27e8f8adfd0a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:20.275429 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-87f7abb1-3be2-4715-bc37-27e8f8adfd0a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:20.275883 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-87f7abb1-3be2-4715-bc37-27e8f8adfd0a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:20.276650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-87f7abb1-3be2-4715-bc37-27e8f8adfd0a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:20.277084 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-87f7abb1-3be2-4715-bc37-27e8f8adfd0a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:20.342316 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-87f7abb1-3be2-4715-bc37-27e8f8adfd0a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:20.356326 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-87f7abb1-3be2-4715-bc37-27e8f8adfd0a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1293 microversion: 2.1 time: 0.092408 May 26 16:59:20.357400 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 363/739] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:20 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:20.591004 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3300e230-3de9-479c-bd95-2f44024ef702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:20.591876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3300e230-3de9-479c-bd95-2f44024ef702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:20.599251 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3300e230-3de9-479c-bd95-2f44024ef702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:20.599765 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3300e230-3de9-479c-bd95-2f44024ef702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:20.600563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3300e230-3de9-479c-bd95-2f44024ef702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:20.601006 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3300e230-3de9-479c-bd95-2f44024ef702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:20.738251 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3300e230-3de9-479c-bd95-2f44024ef702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:20.745768 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3300e230-3de9-479c-bd95-2f44024ef702 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1508 microversion: 2.1 time: 0.158943 May 26 16:59:20.746363 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 377/740] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:20 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:20.977106 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-e8f80d69-a5a9-4ae3-8494-7cdd8d9cf2b7 req-838ede81-6943-4b43-b16f-b434c12fd4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81ee3901-edb0-46c8-9b68-5792f690cf5d", "name": "network-vif-deleted", "tag": "875fe38c-8738-43ba-96e1-889e5291698c"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:20.985221 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-e8f80d69-a5a9-4ae3-8494-7cdd8d9cf2b7 req-838ede81-6943-4b43-b16f-b434c12fd4df service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:20.987409 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-e8f80d69-a5a9-4ae3-8494-7cdd8d9cf2b7 req-838ede81-6943-4b43-b16f-b434c12fd4df service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:21.002436 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-e8f80d69-a5a9-4ae3-8494-7cdd8d9cf2b7 req-838ede81-6943-4b43-b16f-b434c12fd4df service nova] Creating event network-vif-deleted:875fe38c-8738-43ba-96e1-889e5291698c for instance 81ee3901-edb0-46c8-9b68-5792f690cf5d on hv-cinder-83607 May 26 16:59:21.007886 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-e8f80d69-a5a9-4ae3-8494-7cdd8d9cf2b7 req-838ede81-6943-4b43-b16f-b434c12fd4df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034514 May 26 16:59:21.008951 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 364/741] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:21.374609 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-65005b91-6069-4b47-8f55-ba57d85696ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:21.375616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-65005b91-6069-4b47-8f55-ba57d85696ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:21.382438 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-65005b91-6069-4b47-8f55-ba57d85696ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:21.383484 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-65005b91-6069-4b47-8f55-ba57d85696ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:21.383959 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-65005b91-6069-4b47-8f55-ba57d85696ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:21.384406 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-65005b91-6069-4b47-8f55-ba57d85696ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:21.525900 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-65005b91-6069-4b47-8f55-ba57d85696ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:21.534294 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-65005b91-6069-4b47-8f55-ba57d85696ac tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1361 microversion: 2.1 time: 0.163925 May 26 16:59:21.543856 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 378/742] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:21 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:21.764368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-332c63dc-0cbc-4cd1-86a0-5f42fddbd5bb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:21.767916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-332c63dc-0cbc-4cd1-86a0-5f42fddbd5bb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:21.773225 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-332c63dc-0cbc-4cd1-86a0-5f42fddbd5bb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:21.773892 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-332c63dc-0cbc-4cd1-86a0-5f42fddbd5bb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:21.774666 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-332c63dc-0cbc-4cd1-86a0-5f42fddbd5bb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:21.775117 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-332c63dc-0cbc-4cd1-86a0-5f42fddbd5bb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:21.812335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-332c63dc-0cbc-4cd1-86a0-5f42fddbd5bb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:21.812888 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-332c63dc-0cbc-4cd1-86a0-5f42fddbd5bb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:21.813244 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-332c63dc-0cbc-4cd1-86a0-5f42fddbd5bb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lazy-loading 'fault' on Instance uuid 81ee3901-edb0-46c8-9b68-5792f690cf5d {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:59:21.858784 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-332c63dc-0cbc-4cd1-86a0-5f42fddbd5bb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:21.866609 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-332c63dc-0cbc-4cd1-86a0-5f42fddbd5bb tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 200 len: 1312 microversion: 2.1 time: 0.106580 May 26 16:59:21.873806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 365/743] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:21 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:22.552091 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-489a2443-ae12-4f50-bb7f-638f02952247 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:22.554918 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-489a2443-ae12-4f50-bb7f-638f02952247 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:22.559621 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-489a2443-ae12-4f50-bb7f-638f02952247 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:22.560761 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-489a2443-ae12-4f50-bb7f-638f02952247 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:22.561755 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-489a2443-ae12-4f50-bb7f-638f02952247 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:22.562204 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-489a2443-ae12-4f50-bb7f-638f02952247 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:22.701369 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-489a2443-ae12-4f50-bb7f-638f02952247 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:22.709086 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-489a2443-ae12-4f50-bb7f-638f02952247 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1361 microversion: 2.1 time: 0.161576 May 26 16:59:22.709693 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 379/744] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:22 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:22.885116 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0888d1eb-acbb-4b2f-9792-1f9dc4740d5a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:22.889729 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0888d1eb-acbb-4b2f-9792-1f9dc4740d5a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 81ee3901-edb0-46c8-9b68-5792f690cf5d] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:22.892954 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0888d1eb-acbb-4b2f-9792-1f9dc4740d5a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:22.893448 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0888d1eb-acbb-4b2f-9792-1f9dc4740d5a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:22.894226 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0888d1eb-acbb-4b2f-9792-1f9dc4740d5a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:22.894667 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0888d1eb-acbb-4b2f-9792-1f9dc4740d5a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:22.908534 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-0888d1eb-acbb-4b2f-9792-1f9dc4740d5a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] HTTP exception thrown: Instance 81ee3901-edb0-46c8-9b68-5792f690cf5d could not be found. May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0888d1eb-acbb-4b2f-9792-1f9dc4740d5a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Request method failure captured: May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d HTTP/1.1 May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7CH0rRgnMIlqD063iAZ1ez0QCmlEZqp8QO5ZHjV6XSABZyVeCa3_rL4GukWUzmymH9jymZkR9aYr_V2RQaROCLGEkpNcCgSPyMdlFCJNjPh_1Ze5FLmietbK2CJnk7y7SKXRAka654COK9sD96s20UhiFkxqVLsn7TyJAFc87ArqJ8 May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 5150e5b054d34d09a3cb69e35f9c86dd May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1243169788 May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 16:59:22.912897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 16:59:22.915308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5150e5b054d34d09a3cb69e35f9c86dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5150e5b054d34d09a3cb69e35f9c86dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5150e5b054d34d09a3cb69e35f9c86dd", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5150e5b054d34d09a3cb69e35f9c86dd"}]}] May 26 16:59:22.915308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1243169788 May 26 16:59:22.915308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 5150e5b054d34d09a3cb69e35f9c86dd May 26 16:59:22.915308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1243169788 May 26 16:59:22.915308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-ServerRescueNegativeTestJSON-1243169788-project May 26 16:59:22.915308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 16:59:22.915308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 16:59:22.915308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: 1cf5ba73296e41c4ab58a6a962b578d3 May 26 16:59:22.915308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1243169788-project May 26 16:59:22.915308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 16:59:22.915308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance 81ee3901-edb0-46c8-9b68-5792f690cf5d could not be found. May 26 16:59:22.915308 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': '81ee3901-edb0-46c8-9b68-5792f690cf5d'} May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ee3901-edb0-46c8-9b68-5792f690cf5d could not be found. May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:59:22.916798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ee3901-edb0-46c8-9b68-5792f690cf5d could not be found. May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ee3901-edb0-46c8-9b68-5792f690cf5d could not be found. May 26 16:59:22.919250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:59:22.921475 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0888d1eb-acbb-4b2f-9792-1f9dc4740d5a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Returning 404 to user: Instance 81ee3901-edb0-46c8-9b68-5792f690cf5d could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:59:22.921475 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0888d1eb-acbb-4b2f-9792-1f9dc4740d5a tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d" status: 404 len: 111 microversion: 2.1 time: 0.031654 May 26 16:59:22.921475 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 366/745] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:22 2022] GET /compute/v2.1/servers/81ee3901-edb0-46c8-9b68-5792f690cf5d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:59:22.921842 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-fe5d0db9-4c2d-456a-ab33-68d22750bb43 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:22.921842 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-fe5d0db9-4c2d-456a-ab33-68d22750bb43 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:22.928232 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fe5d0db9-4c2d-456a-ab33-68d22750bb43 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:22.928677 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fe5d0db9-4c2d-456a-ab33-68d22750bb43 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:22.929489 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fe5d0db9-4c2d-456a-ab33-68d22750bb43 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:22.929925 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fe5d0db9-4c2d-456a-ab33-68d22750bb43 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:22.958601 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-fe5d0db9-4c2d-456a-ab33-68d22750bb43 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Going to try to terminate instance {{(pid=124836) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:59:23.022701 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-b6dba1c4-b50a-46e7-b0b4-9d93e97adae0 req-8496820b-8587-4376-abd1-330047176324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c09b3b4-c5ad-40d6-a92e-66fccb618e11", "tag": "3deb4b98-258a-4325-9a71-e08fb22b0d5d"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:23.040537 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-b6dba1c4-b50a-46e7-b0b4-9d93e97adae0 req-8496820b-8587-4376-abd1-330047176324 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:23.040537 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-b6dba1c4-b50a-46e7-b0b4-9d93e97adae0 req-8496820b-8587-4376-abd1-330047176324 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:23.042737 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-b6dba1c4-b50a-46e7-b0b4-9d93e97adae0 req-8496820b-8587-4376-abd1-330047176324 service nova] Creating event network-changed:3deb4b98-258a-4325-9a71-e08fb22b0d5d for instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 on hv-cinder-83607 May 26 16:59:23.047843 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-b6dba1c4-b50a-46e7-b0b4-9d93e97adae0 req-8496820b-8587-4376-abd1-330047176324 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029001 May 26 16:59:23.048960 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 367/746] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 16:59:23.317186 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-fe5d0db9-4c2d-456a-ab33-68d22750bb43 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 204 len: 0 microversion: 2.1 time: 0.399602 May 26 16:59:23.317832 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 380/747] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 16:59:22 2022] DELETE /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:59:23.327450 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3c1004e7-12e2-4a9a-97ba-dcdccedcd4d0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:23.328130 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3c1004e7-12e2-4a9a-97ba-dcdccedcd4d0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:23.334657 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3c1004e7-12e2-4a9a-97ba-dcdccedcd4d0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:23.335105 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3c1004e7-12e2-4a9a-97ba-dcdccedcd4d0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:23.335889 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3c1004e7-12e2-4a9a-97ba-dcdccedcd4d0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:23.336321 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3c1004e7-12e2-4a9a-97ba-dcdccedcd4d0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:23.467909 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3c1004e7-12e2-4a9a-97ba-dcdccedcd4d0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:23.476769 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3c1004e7-12e2-4a9a-97ba-dcdccedcd4d0 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.153698 May 26 16:59:23.477365 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 368/748] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:23 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:23.727551 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-72ffa9b3-d0d0-4f38-8fcb-348f48fecc91 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:23.728164 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-72ffa9b3-d0d0-4f38-8fcb-348f48fecc91 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:23.734747 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-72ffa9b3-d0d0-4f38-8fcb-348f48fecc91 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:23.735187 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-72ffa9b3-d0d0-4f38-8fcb-348f48fecc91 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:23.735949 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-72ffa9b3-d0d0-4f38-8fcb-348f48fecc91 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:23.736388 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-72ffa9b3-d0d0-4f38-8fcb-348f48fecc91 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:23.869055 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-72ffa9b3-d0d0-4f38-8fcb-348f48fecc91 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:23.877444 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-72ffa9b3-d0d0-4f38-8fcb-348f48fecc91 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1361 microversion: 2.1 time: 0.154375 May 26 16:59:23.878024 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 381/749] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:23 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:24.494494 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9524a266-2f9c-4d89-97cb-6e937b5365d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:24.495125 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9524a266-2f9c-4d89-97cb-6e937b5365d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:24.502345 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9524a266-2f9c-4d89-97cb-6e937b5365d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:24.509505 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9524a266-2f9c-4d89-97cb-6e937b5365d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:24.509505 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9524a266-2f9c-4d89-97cb-6e937b5365d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:24.509505 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9524a266-2f9c-4d89-97cb-6e937b5365d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:24.643722 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9524a266-2f9c-4d89-97cb-6e937b5365d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:24.651425 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9524a266-2f9c-4d89-97cb-6e937b5365d3 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.161026 May 26 16:59:24.653458 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 369/750] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:24 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:24.894633 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6e754780-fcb8-4e2b-966d-992ca21c2c5e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:24.895249 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6e754780-fcb8-4e2b-966d-992ca21c2c5e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:24.901882 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6e754780-fcb8-4e2b-966d-992ca21c2c5e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:24.902338 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6e754780-fcb8-4e2b-966d-992ca21c2c5e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:24.903102 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6e754780-fcb8-4e2b-966d-992ca21c2c5e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:24.903546 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6e754780-fcb8-4e2b-966d-992ca21c2c5e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:25.035810 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6e754780-fcb8-4e2b-966d-992ca21c2c5e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:25.043496 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6e754780-fcb8-4e2b-966d-992ca21c2c5e tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1361 microversion: 2.1 time: 0.152732 May 26 16:59:25.044081 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 382/751] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:24 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:25.669333 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4e36b13c-f7e2-4982-b598-459fbe5fb745 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:25.669990 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4e36b13c-f7e2-4982-b598-459fbe5fb745 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:25.676578 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4e36b13c-f7e2-4982-b598-459fbe5fb745 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:25.677033 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4e36b13c-f7e2-4982-b598-459fbe5fb745 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:25.677874 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4e36b13c-f7e2-4982-b598-459fbe5fb745 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:25.678324 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4e36b13c-f7e2-4982-b598-459fbe5fb745 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:25.826063 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4e36b13c-f7e2-4982-b598-459fbe5fb745 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:25.839968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4e36b13c-f7e2-4982-b598-459fbe5fb745 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.174180 May 26 16:59:25.841370 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 370/752] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:25 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:26.060671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-28247d40-8d95-4050-8294-c2e2c7570ce2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:26.061329 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-28247d40-8d95-4050-8294-c2e2c7570ce2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:26.063276 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:26.064565 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=10 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:26.070026 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-28247d40-8d95-4050-8294-c2e2c7570ce2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:26.070487 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-28247d40-8d95-4050-8294-c2e2c7570ce2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:26.077194 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-28247d40-8d95-4050-8294-c2e2c7570ce2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:26.077194 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-28247d40-8d95-4050-8294-c2e2c7570ce2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:26.207435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-28247d40-8d95-4050-8294-c2e2c7570ce2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:26.214801 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-28247d40-8d95-4050-8294-c2e2c7570ce2 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1361 microversion: 2.1 time: 0.158154 May 26 16:59:26.215398 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 383/753] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:26 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:26.866249 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-46065315-a2e2-4ca5-b7ea-250b43c56c05 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:26.866857 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-46065315-a2e2-4ca5-b7ea-250b43c56c05 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:26.868975 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:26.874399 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-46065315-a2e2-4ca5-b7ea-250b43c56c05 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:26.874848 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-46065315-a2e2-4ca5-b7ea-250b43c56c05 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:26.875650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-46065315-a2e2-4ca5-b7ea-250b43c56c05 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:26.876120 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-46065315-a2e2-4ca5-b7ea-250b43c56c05 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:27.016610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-46065315-a2e2-4ca5-b7ea-250b43c56c05 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:27.026358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-46065315-a2e2-4ca5-b7ea-250b43c56c05 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1522 microversion: 2.1 time: 0.164028 May 26 16:59:27.027265 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 371/754] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:26 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:59:27.232256 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b26b67d8-3537-4559-83b8-f3478c614997 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:27.232886 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b26b67d8-3537-4559-83b8-f3478c614997 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:27.239477 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b26b67d8-3537-4559-83b8-f3478c614997 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:27.239970 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b26b67d8-3537-4559-83b8-f3478c614997 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:27.240722 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b26b67d8-3537-4559-83b8-f3478c614997 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:27.241154 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b26b67d8-3537-4559-83b8-f3478c614997 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:27.378016 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b26b67d8-3537-4559-83b8-f3478c614997 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:27.386099 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b26b67d8-3537-4559-83b8-f3478c614997 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1361 microversion: 2.1 time: 0.157615 May 26 16:59:27.386698 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 384/755] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:27 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:27.710580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-d95dae1e-a9cb-4329-9010-39c55f6366ee req-d69420c6-de3b-4f50-8116-743ae1569236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c09b3b4-c5ad-40d6-a92e-66fccb618e11", "name": "network-vif-plugged", "status": "completed", "tag": "3deb4b98-258a-4325-9a71-e08fb22b0d5d"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:27.719082 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-d95dae1e-a9cb-4329-9010-39c55f6366ee req-d69420c6-de3b-4f50-8116-743ae1569236 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:27.719429 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-d95dae1e-a9cb-4329-9010-39c55f6366ee req-d69420c6-de3b-4f50-8116-743ae1569236 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:27.731872 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-d95dae1e-a9cb-4329-9010-39c55f6366ee req-d69420c6-de3b-4f50-8116-743ae1569236 service nova] Creating event network-vif-plugged:3deb4b98-258a-4325-9a71-e08fb22b0d5d for instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 on hv-cinder-83607 May 26 16:59:27.737146 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-d95dae1e-a9cb-4329-9010-39c55f6366ee req-d69420c6-de3b-4f50-8116-743ae1569236 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030872 May 26 16:59:27.737844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 372/756] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:28.044166 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9b6fb57b-e39f-40da-9488-b6a71a0b829c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:28.044780 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9b6fb57b-e39f-40da-9488-b6a71a0b829c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:28.051868 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b6fb57b-e39f-40da-9488-b6a71a0b829c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:28.052325 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b6fb57b-e39f-40da-9488-b6a71a0b829c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:28.053103 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b6fb57b-e39f-40da-9488-b6a71a0b829c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:28.053579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b6fb57b-e39f-40da-9488-b6a71a0b829c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:28.137481 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9b6fb57b-e39f-40da-9488-b6a71a0b829c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:28.145307 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9b6fb57b-e39f-40da-9488-b6a71a0b829c tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1480 microversion: 2.1 time: 0.105026 May 26 16:59:28.145902 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 385/757] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:28 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1480 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:28.170544 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-1c900bb0-36ef-463a-8fca-dcb7de3c433b req-91840ce0-a4ae-4ee9-b774-f8bc2f79f56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ecc34c3-8a11-43df-b56d-0996916a0187", "name": "network-vif-deleted", "tag": "50fe6234-052f-41cc-8a4f-a24813700c3e"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:28.181241 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-1c900bb0-36ef-463a-8fca-dcb7de3c433b req-91840ce0-a4ae-4ee9-b774-f8bc2f79f56c service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:28.181241 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-1c900bb0-36ef-463a-8fca-dcb7de3c433b req-91840ce0-a4ae-4ee9-b774-f8bc2f79f56c service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:28.194702 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-1c900bb0-36ef-463a-8fca-dcb7de3c433b req-91840ce0-a4ae-4ee9-b774-f8bc2f79f56c service nova] Creating event network-vif-deleted:50fe6234-052f-41cc-8a4f-a24813700c3e for instance 3ecc34c3-8a11-43df-b56d-0996916a0187 on hv-cinder-83607 May 26 16:59:28.199954 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-1c900bb0-36ef-463a-8fca-dcb7de3c433b req-91840ce0-a4ae-4ee9-b774-f8bc2f79f56c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033725 May 26 16:59:28.200553 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 373/758] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:28.403235 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4b1dd947-d623-40a6-b445-b984885f2c9f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:28.403798 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4b1dd947-d623-40a6-b445-b984885f2c9f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:28.411106 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4b1dd947-d623-40a6-b445-b984885f2c9f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:28.411577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4b1dd947-d623-40a6-b445-b984885f2c9f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:28.412335 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4b1dd947-d623-40a6-b445-b984885f2c9f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:28.412774 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4b1dd947-d623-40a6-b445-b984885f2c9f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:28.555545 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4b1dd947-d623-40a6-b445-b984885f2c9f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:28.563592 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4b1dd947-d623-40a6-b445-b984885f2c9f tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1361 microversion: 2.1 time: 0.164264 May 26 16:59:28.564183 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 386/759] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:28 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:29.162761 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-dfeeeb23-6f96-4756-9219-ddec96db60cd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:29.163410 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-dfeeeb23-6f96-4756-9219-ddec96db60cd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:29.170243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dfeeeb23-6f96-4756-9219-ddec96db60cd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:29.170698 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dfeeeb23-6f96-4756-9219-ddec96db60cd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:29.171464 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dfeeeb23-6f96-4756-9219-ddec96db60cd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:29.171907 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dfeeeb23-6f96-4756-9219-ddec96db60cd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:29.203612 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dfeeeb23-6f96-4756-9219-ddec96db60cd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:29.204074 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dfeeeb23-6f96-4756-9219-ddec96db60cd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:29.204626 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-dfeeeb23-6f96-4756-9219-ddec96db60cd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lazy-loading 'fault' on Instance uuid 3ecc34c3-8a11-43df-b56d-0996916a0187 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:59:29.247058 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-dfeeeb23-6f96-4756-9219-ddec96db60cd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:29.254550 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-dfeeeb23-6f96-4756-9219-ddec96db60cd tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1312 microversion: 2.1 time: 0.096240 May 26 16:59:29.255111 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 374/760] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:29 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:29.580761 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7fe5b31d-af89-4750-a3a2-47802c0e8672 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:29.581447 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7fe5b31d-af89-4750-a3a2-47802c0e8672 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:29.588040 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7fe5b31d-af89-4750-a3a2-47802c0e8672 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:29.588492 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7fe5b31d-af89-4750-a3a2-47802c0e8672 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:29.589246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7fe5b31d-af89-4750-a3a2-47802c0e8672 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:29.589707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7fe5b31d-af89-4750-a3a2-47802c0e8672 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:29.727374 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7fe5b31d-af89-4750-a3a2-47802c0e8672 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:29.735090 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7fe5b31d-af89-4750-a3a2-47802c0e8672 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1361 microversion: 2.1 time: 0.158792 May 26 16:59:29.735674 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 387/761] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:29 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 16:59:30.271618 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cc90b901-1776-479d-aad5-35952481f541 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:30.272230 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cc90b901-1776-479d-aad5-35952481f541 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:30.278758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc90b901-1776-479d-aad5-35952481f541 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:30.279207 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc90b901-1776-479d-aad5-35952481f541 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:30.279960 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc90b901-1776-479d-aad5-35952481f541 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:30.280393 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc90b901-1776-479d-aad5-35952481f541 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:30.310941 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc90b901-1776-479d-aad5-35952481f541 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:30.311388 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cc90b901-1776-479d-aad5-35952481f541 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:30.311836 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-cc90b901-1776-479d-aad5-35952481f541 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lazy-loading 'fault' on Instance uuid 3ecc34c3-8a11-43df-b56d-0996916a0187 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:59:30.314589 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:30.357410 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cc90b901-1776-479d-aad5-35952481f541 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf5ba73296e41c4ab58a6a962b578d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5150e5b054d34d09a3cb69e35f9c86dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:30.364953 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cc90b901-1776-479d-aad5-35952481f541 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 200 len: 1312 microversion: 2.1 time: 0.097147 May 26 16:59:30.365510 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 375/762] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:30 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:30.751757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5c752bdf-ec3f-4bfa-8d82-43642e24cf37 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:30.752368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5c752bdf-ec3f-4bfa-8d82-43642e24cf37 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:30.759216 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5c752bdf-ec3f-4bfa-8d82-43642e24cf37 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:30.759671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5c752bdf-ec3f-4bfa-8d82-43642e24cf37 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:30.760443 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5c752bdf-ec3f-4bfa-8d82-43642e24cf37 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:30.760886 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5c752bdf-ec3f-4bfa-8d82-43642e24cf37 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:30.893426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5c752bdf-ec3f-4bfa-8d82-43642e24cf37 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:30.901600 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5c752bdf-ec3f-4bfa-8d82-43642e24cf37 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1548 microversion: 2.1 time: 0.154220 May 26 16:59:30.902166 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 388/763] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:30 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 16:59:30.917991 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-046f4060-86bc-4759-8361-48579ff8243b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:30.918488 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-046f4060-86bc-4759-8361-48579ff8243b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:30.925117 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-046f4060-86bc-4759-8361-48579ff8243b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:30.925593 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-046f4060-86bc-4759-8361-48579ff8243b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:30.926355 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-046f4060-86bc-4759-8361-48579ff8243b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:30.926793 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-046f4060-86bc-4759-8361-48579ff8243b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:31.004059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-046f4060-86bc-4759-8361-48579ff8243b tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089878 May 26 16:59:31.004654 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 376/764] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 26 16:59:30 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:31.382363 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ed4dcec4-a666-4340-ae18-bb4ff55151d2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:31.383010 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ed4dcec4-a666-4340-ae18-bb4ff55151d2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] [instance: 3ecc34c3-8a11-43df-b56d-0996916a0187] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:31.389641 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ed4dcec4-a666-4340-ae18-bb4ff55151d2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:31.390093 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ed4dcec4-a666-4340-ae18-bb4ff55151d2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:31.390850 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ed4dcec4-a666-4340-ae18-bb4ff55151d2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:31.391313 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ed4dcec4-a666-4340-ae18-bb4ff55151d2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:31.404985 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-ed4dcec4-a666-4340-ae18-bb4ff55151d2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] HTTP exception thrown: Instance 3ecc34c3-8a11-43df-b56d-0996916a0187 could not be found. May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ed4dcec4-a666-4340-ae18-bb4ff55151d2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Request method failure captured: May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 HTTP/1.1 May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7CH0rRgnMIlqD063iAZ1ez0QCmlEZqp8QO5ZHjV6XSABZyVeCa3_rL4GukWUzmymH9jymZkR9aYr_V2RQaROCLGEkpNcCgSPyMdlFCJNjPh_1Ze5FLmietbK2CJnk7y7SKXRAka654COK9sD96s20UhiFkxqVLsn7TyJAFc87ArqJ8 May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 5150e5b054d34d09a3cb69e35f9c86dd May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1243169788 May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 16:59:31.406928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 16:59:31.408956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5150e5b054d34d09a3cb69e35f9c86dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5150e5b054d34d09a3cb69e35f9c86dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5150e5b054d34d09a3cb69e35f9c86dd", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5150e5b054d34d09a3cb69e35f9c86dd"}]}] May 26 16:59:31.408956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1243169788 May 26 16:59:31.408956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 5150e5b054d34d09a3cb69e35f9c86dd May 26 16:59:31.408956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1243169788 May 26 16:59:31.408956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-ServerRescueNegativeTestJSON-1243169788-project May 26 16:59:31.408956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 16:59:31.408956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 16:59:31.408956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 1cf5ba73296e41c4ab58a6a962b578d3 May 26 16:59:31.408956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1243169788-project May 26 16:59:31.408956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 16:59:31.408956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 3ecc34c3-8a11-43df-b56d-0996916a0187 could not be found. May 26 16:59:31.408956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '3ecc34c3-8a11-43df-b56d-0996916a0187'} May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ecc34c3-8a11-43df-b56d-0996916a0187 could not be found. May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:59:31.409736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ecc34c3-8a11-43df-b56d-0996916a0187 could not be found. May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ecc34c3-8a11-43df-b56d-0996916a0187 could not be found. May 26 16:59:31.410935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 16:59:31.412060 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ed4dcec4-a666-4340-ae18-bb4ff55151d2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] Returning 404 to user: Instance 3ecc34c3-8a11-43df-b56d-0996916a0187 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:59:31.412060 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ed4dcec4-a666-4340-ae18-bb4ff55151d2 tempest-ServerRescueNegativeTestJSON-1243169788 tempest-ServerRescueNegativeTestJSON-1243169788-project] 10.222.0.48 "GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187" status: 404 len: 111 microversion: 2.1 time: 0.030477 May 26 16:59:31.412060 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 389/765] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:31 2022] GET /compute/v2.1/servers/3ecc34c3-8a11-43df-b56d-0996916a0187 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 16:59:32.026061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-03c0cee0-548e-4d4e-a153-2e5c7ecb6650 req-70552d0e-27c4-47ca-8e97-25170706d845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c09b3b4-c5ad-40d6-a92e-66fccb618e11", "tag": "3deb4b98-258a-4325-9a71-e08fb22b0d5d"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:32.036579 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-03c0cee0-548e-4d4e-a153-2e5c7ecb6650 req-70552d0e-27c4-47ca-8e97-25170706d845 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:32.037153 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-03c0cee0-548e-4d4e-a153-2e5c7ecb6650 req-70552d0e-27c4-47ca-8e97-25170706d845 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:32.050262 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-03c0cee0-548e-4d4e-a153-2e5c7ecb6650 req-70552d0e-27c4-47ca-8e97-25170706d845 service nova] Creating event network-changed:3deb4b98-258a-4325-9a71-e08fb22b0d5d for instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 on hv-cinder-83607 May 26 16:59:32.055738 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-03c0cee0-548e-4d4e-a153-2e5c7ecb6650 req-70552d0e-27c4-47ca-8e97-25170706d845 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035043 May 26 16:59:32.056748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 377/766] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 16:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:45.023751 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-18bdcf65-ff41-4396-bb40-bf1a888b6f09 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:45.024326 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-18bdcf65-ff41-4396-bb40-bf1a888b6f09 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:45.026972 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:45.027627 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:45.032386 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-18bdcf65-ff41-4396-bb40-bf1a888b6f09 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:45.032839 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-18bdcf65-ff41-4396-bb40-bf1a888b6f09 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:45.033671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-18bdcf65-ff41-4396-bb40-bf1a888b6f09 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:45.034112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-18bdcf65-ff41-4396-bb40-bf1a888b6f09 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:45.057685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-18bdcf65-ff41-4396-bb40-bf1a888b6f09 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/ips" status: 200 len: 150 microversion: 2.1 time: 0.037927 May 26 16:59:45.058330 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 390/767] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 26 16:59:45 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:46.798299 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:46.799050 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=9 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:46.803451 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-78810a7b-8f91-46a2-8a4a-0f038a2427c9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4d25eba-2004-4905-87b5-af978d842800"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:46.804740 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-78810a7b-8f91-46a2-8a4a-0f038a2427c9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:46.810836 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-78810a7b-8f91-46a2-8a4a-0f038a2427c9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:46.811293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-78810a7b-8f91-46a2-8a4a-0f038a2427c9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:46.812063 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-78810a7b-8f91-46a2-8a4a-0f038a2427c9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:46.812556 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-78810a7b-8f91-46a2-8a4a-0f038a2427c9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:47.697249 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-78810a7b-8f91-46a2-8a4a-0f038a2427c9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "POST /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.900464 May 26 16:59:47.697958 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 378/768] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 26 16:59:46 2022] POST /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/os-volume_attachments => generated 194 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:54.642576 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-33df30c3-b083-499a-9ec3-ca9ce03c2223 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:54.643178 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-33df30c3-b083-499a-9ec3-ca9ce03c2223 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:54.650320 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-33df30c3-b083-499a-9ec3-ca9ce03c2223 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:54.650845 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-33df30c3-b083-499a-9ec3-ca9ce03c2223 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:54.651644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-33df30c3-b083-499a-9ec3-ca9ce03c2223 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:54.652086 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-33df30c3-b083-499a-9ec3-ca9ce03c2223 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:54.677465 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-33df30c3-b083-499a-9ec3-ca9ce03c2223 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1/ips" status: 200 len: 152 microversion: 2.20 time: 0.039851 May 26 16:59:54.678117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 391/769] 10.222.0.48 () {60 vars in 1288 bytes} [Thu May 26 16:59:54 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 16:59:56.668697 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b704c306-d8af-461f-a128-daf447aa4ba1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4d25eba-2004-4905-87b5-af978d842800"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:56.669972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b704c306-d8af-461f-a128-daf447aa4ba1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:56.677339 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b704c306-d8af-461f-a128-daf447aa4ba1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:56.677795 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b704c306-d8af-461f-a128-daf447aa4ba1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:56.678576 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b704c306-d8af-461f-a128-daf447aa4ba1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:56.679030 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b704c306-d8af-461f-a128-daf447aa4ba1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:56.767161 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-b704c306-d8af-461f-a128-daf447aa4ba1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] HTTP exception thrown: Invalid volume: volume f4d25eba-2004-4905-87b5-af978d842800 is already attached to instances: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b704c306-d8af-461f-a128-daf447aa4ba1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Request method failure captured: May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: POST /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/os-volume_attachments HTTP/1.1 May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 74 May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7DzbhltvfRlN11wtcZ5l_X_WvcTEIigXlOrGIiq9Yx6XlBxWNmzLmNABRCmLnPTr4rRVR4UaIBjMcSZhnziOK1SfjgVmtsWHcVwpG_z7xB0-B1QZy0o_2qrsjZYhxYRjwS8MjkCFlKcl1g60M7fXrlp400fuazE8HitBHbMDtgjELA May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 16:59:56.768910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 16:59:56.770586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_060af6cf4f7a48758f6859bd3766ae1b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/060af6cf4f7a48758f6859bd3766ae1b"}]}] May 26 16:59:56.770586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeNegativeTest-1609360552 May 26 16:59:56.770586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 16:59:56.770586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 16:59:56.770586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeNegativeTest-1609360552-project May 26 16:59:56.770586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 16:59:56.770586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 16:59:56.770586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: 1551f28754a64d1d9010ed90b67c5dc4 May 26 16:59:56.770586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeNegativeTest-1609360552-project May 26 16:59:56.770586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: May 26 16:59:56.770586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {"volumeAttachment": {"volumeId": "f4d25eba-2004-4905-87b5-af978d842800"}} May 26 16:59:56.770586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Invalid volume: volume f4d25eba-2004-4905-87b5-af978d842800 is already attached to instances: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'server_id': '3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3', 'body': {'volumeAttachment': {'volumeId': 'f4d25eba-2004-4905-87b5-af978d842800'}}} May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f4d25eba-2004-4905-87b5-af978d842800 is already attached to instances: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:59:56.771580 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f4d25eba-2004-4905-87b5-af978d842800 is already attached to instances: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 16:59:56.773099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 16:59:56.774631 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 16:59:56.774631 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 16:59:56.774631 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 16:59:56.774631 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f4d25eba-2004-4905-87b5-af978d842800 is already attached to instances: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 May 26 16:59:56.774631 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 16:59:56.774631 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b704c306-d8af-461f-a128-daf447aa4ba1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Returning 400 to user: Invalid volume: volume f4d25eba-2004-4905-87b5-af978d842800 is already attached to instances: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 16:59:56.774631 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b704c306-d8af-461f-a128-daf447aa4ba1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "POST /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107041 May 26 16:59:56.774631 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 379/770] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 26 16:59:56 2022] POST /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 16:59:56.835520 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e98e855e-586c-4779-82d7-10ec6d05b4b0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:56.836038 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e98e855e-586c-4779-82d7-10ec6d05b4b0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:56.843648 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e98e855e-586c-4779-82d7-10ec6d05b4b0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:56.844125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e98e855e-586c-4779-82d7-10ec6d05b4b0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:56.844895 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e98e855e-586c-4779-82d7-10ec6d05b4b0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:56.845434 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e98e855e-586c-4779-82d7-10ec6d05b4b0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:56.935140 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-e98e855e-586c-4779-82d7-10ec6d05b4b0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lazy-loading 'services' on Instance uuid 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:59:57.259095 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e98e855e-586c-4779-82d7-10ec6d05b4b0 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/os-volume_attachments/f4d25eba-2004-4905-87b5-af978d842800" status: 202 len: 0 microversion: 2.1 time: 0.428055 May 26 16:59:57.259693 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 392/771] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 26 16:59:56 2022] DELETE /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/os-volume_attachments/f4d25eba-2004-4905-87b5-af978d842800 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 16:59:57.268830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c6ba984e-2a4f-4359-bdbe-ac017214885d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:57.269822 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c6ba984e-2a4f-4359-bdbe-ac017214885d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:57.277966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c6ba984e-2a4f-4359-bdbe-ac017214885d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:57.278421 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c6ba984e-2a4f-4359-bdbe-ac017214885d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:57.279318 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c6ba984e-2a4f-4359-bdbe-ac017214885d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:57.279787 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c6ba984e-2a4f-4359-bdbe-ac017214885d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:57.309718 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c6ba984e-2a4f-4359-bdbe-ac017214885d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045494 May 26 16:59:57.310280 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 380/772] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 16:59:57 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:57.927355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-40466811-2394-4300-9bd5-d9428de565e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 16:59:57.927968 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-40466811-2394-4300-9bd5-d9428de565e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:57.934791 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-40466811-2394-4300-9bd5-d9428de565e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:57.935237 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-40466811-2394-4300-9bd5-d9428de565e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:57.936001 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-40466811-2394-4300-9bd5-d9428de565e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:57.936432 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-40466811-2394-4300-9bd5-d9428de565e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:57.959948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-40466811-2394-4300-9bd5-d9428de565e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lazy-loading 'flavor' on Instance uuid 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 16:59:58.322260 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-57ad2bed-e3a1-4618-9975-690d7d68b7be tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:58.323314 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-57ad2bed-e3a1-4618-9975-690d7d68b7be tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:58.330212 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-57ad2bed-e3a1-4618-9975-690d7d68b7be tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:58.330748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-57ad2bed-e3a1-4618-9975-690d7d68b7be tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:58.331636 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-57ad2bed-e3a1-4618-9975-690d7d68b7be tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:58.332154 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-57ad2bed-e3a1-4618-9975-690d7d68b7be tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:58.364435 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-57ad2bed-e3a1-4618-9975-690d7d68b7be tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046136 May 26 16:59:58.368533 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 381/773] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 16:59:58 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 16:59:58.589521 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-40466811-2394-4300-9bd5-d9428de565e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "POST /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1/action" status: 202 len: 0 microversion: 2.20 time: 0.666662 May 26 16:59:58.593571 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 393/774] 10.222.0.48 () {62 vars in 1318 bytes} [Thu May 26 16:59:57 2022] POST /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 16:59:58.600389 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3634bacd-5469-4701-9b57-6d13791ac6b4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:58.601188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3634bacd-5469-4701-9b57-6d13791ac6b4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:58.607626 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3634bacd-5469-4701-9b57-6d13791ac6b4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:58.608066 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3634bacd-5469-4701-9b57-6d13791ac6b4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:58.608848 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3634bacd-5469-4701-9b57-6d13791ac6b4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:58.609313 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3634bacd-5469-4701-9b57-6d13791ac6b4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:58.757894 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3634bacd-5469-4701-9b57-6d13791ac6b4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:58.767023 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3634bacd-5469-4701-9b57-6d13791ac6b4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:58.768538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3634bacd-5469-4701-9b57-6d13791ac6b4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:58.769738 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3634bacd-5469-4701-9b57-6d13791ac6b4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.174041 May 26 16:59:58.770384 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 382/775] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:59:58 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 16:59:59.377422 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-603466fd-f7bc-4350-b16b-6bc25e0021d2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:59.378339 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-603466fd-f7bc-4350-b16b-6bc25e0021d2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:59.384958 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-603466fd-f7bc-4350-b16b-6bc25e0021d2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:59.385449 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-603466fd-f7bc-4350-b16b-6bc25e0021d2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:59.386329 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-603466fd-f7bc-4350-b16b-6bc25e0021d2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:59.386684 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-603466fd-f7bc-4350-b16b-6bc25e0021d2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:59.417842 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-603466fd-f7bc-4350-b16b-6bc25e0021d2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045442 May 26 16:59:59.418398 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 394/776] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 16:59:59 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 16:59:59.478708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b077dced-3075-49f7-8add-867e9b1cdbdd tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:59.479277 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b077dced-3075-49f7-8add-867e9b1cdbdd tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:59.486957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b077dced-3075-49f7-8add-867e9b1cdbdd tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:59.487403 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b077dced-3075-49f7-8add-867e9b1cdbdd tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:59.488166 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b077dced-3075-49f7-8add-867e9b1cdbdd tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:59.488631 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b077dced-3075-49f7-8add-867e9b1cdbdd tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:59.514563 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b077dced-3075-49f7-8add-867e9b1cdbdd tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 16:59:59.788600 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f0502d90-8908-4652-a1e2-d1dbbd464adc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:59.789406 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f0502d90-8908-4652-a1e2-d1dbbd464adc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:59.796699 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f0502d90-8908-4652-a1e2-d1dbbd464adc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:59.797627 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f0502d90-8908-4652-a1e2-d1dbbd464adc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:59.798433 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f0502d90-8908-4652-a1e2-d1dbbd464adc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:59.798875 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f0502d90-8908-4652-a1e2-d1dbbd464adc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:59.865830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b077dced-3075-49f7-8add-867e9b1cdbdd tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 204 len: 0 microversion: 2.1 time: 0.390831 May 26 16:59:59.866697 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 383/777] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 16:59:59 2022] DELETE /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 16:59:59.876817 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1d3b2e36-abff-4a5a-b3a1-e96b05b92cc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 16:59:59.877629 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1d3b2e36-abff-4a5a-b3a1-e96b05b92cc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 16:59:59.883953 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d3b2e36-abff-4a5a-b3a1-e96b05b92cc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:59.884422 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d3b2e36-abff-4a5a-b3a1-e96b05b92cc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:59.885403 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d3b2e36-abff-4a5a-b3a1-e96b05b92cc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 16:59:59.886011 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d3b2e36-abff-4a5a-b3a1-e96b05b92cc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 16:59:59.952345 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f0502d90-8908-4652-a1e2-d1dbbd464adc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:59.961009 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f0502d90-8908-4652-a1e2-d1dbbd464adc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:59.962534 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f0502d90-8908-4652-a1e2-d1dbbd464adc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 16:59:59.963697 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f0502d90-8908-4652-a1e2-d1dbbd464adc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.179061 May 26 16:59:59.964253 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 395/778] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 16:59:59 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:00:00.039384 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1d3b2e36-abff-4a5a-b3a1-e96b05b92cc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:00.048701 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1d3b2e36-abff-4a5a-b3a1-e96b05b92cc1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1682 microversion: 2.1 time: 0.176860 May 26 17:00:00.049747 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 384/779] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 16:59:59 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:00.983081 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a63419fe-d663-4d9f-8050-fe12310ad132 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:00.983726 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a63419fe-d663-4d9f-8050-fe12310ad132 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:00.990846 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a63419fe-d663-4d9f-8050-fe12310ad132 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:00.991302 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a63419fe-d663-4d9f-8050-fe12310ad132 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:00.992073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a63419fe-d663-4d9f-8050-fe12310ad132 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:00.992516 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a63419fe-d663-4d9f-8050-fe12310ad132 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:01.067586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-984f7f91-7606-4582-aef4-83094b76b7ee tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:01.069063 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-984f7f91-7606-4582-aef4-83094b76b7ee tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:01.077353 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-984f7f91-7606-4582-aef4-83094b76b7ee tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:01.079429 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-984f7f91-7606-4582-aef4-83094b76b7ee tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:01.080535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-984f7f91-7606-4582-aef4-83094b76b7ee tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:01.081140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-984f7f91-7606-4582-aef4-83094b76b7ee tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:01.166112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a63419fe-d663-4d9f-8050-fe12310ad132 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:01.174712 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a63419fe-d663-4d9f-8050-fe12310ad132 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:01.176229 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a63419fe-d663-4d9f-8050-fe12310ad132 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:01.177438 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a63419fe-d663-4d9f-8050-fe12310ad132 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.198436 May 26 17:00:01.178187 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 396/780] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:00 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:01.247949 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-984f7f91-7606-4582-aef4-83094b76b7ee tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:01.259003 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-984f7f91-7606-4582-aef4-83094b76b7ee tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1682 microversion: 2.1 time: 0.195832 May 26 17:00:01.259585 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 385/781] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:01 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:02.195911 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1a3141c7-d14a-450e-8699-966d347bbffa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:02.196531 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1a3141c7-d14a-450e-8699-966d347bbffa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:02.203622 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1a3141c7-d14a-450e-8699-966d347bbffa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:02.204075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1a3141c7-d14a-450e-8699-966d347bbffa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:02.204855 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1a3141c7-d14a-450e-8699-966d347bbffa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:02.205315 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1a3141c7-d14a-450e-8699-966d347bbffa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:02.277136 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-40d61cf4-7591-471c-958b-bca57fc5522f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:02.277778 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-40d61cf4-7591-471c-958b-bca57fc5522f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:02.285222 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-40d61cf4-7591-471c-958b-bca57fc5522f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:02.285993 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-40d61cf4-7591-471c-958b-bca57fc5522f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:02.286465 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-40d61cf4-7591-471c-958b-bca57fc5522f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:02.292141 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-40d61cf4-7591-471c-958b-bca57fc5522f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:02.369060 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1a3141c7-d14a-450e-8699-966d347bbffa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:02.378320 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1a3141c7-d14a-450e-8699-966d347bbffa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:02.392326 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1a3141c7-d14a-450e-8699-966d347bbffa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:02.392326 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-1a3141c7-d14a-450e-8699-966d347bbffa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.189389 May 26 17:00:02.393528 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 397/782] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:02 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:02.457135 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-40d61cf4-7591-471c-958b-bca57fc5522f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:02.464740 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-40d61cf4-7591-471c-958b-bca57fc5522f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1682 microversion: 2.1 time: 0.191426 May 26 17:00:02.465322 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 386/783] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:02 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:03.359125 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-ec0ac7e3-9913-44a8-a427-08bc173dcb7d req-a1947674-2360-4527-8532-210b889698c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3", "name": "network-vif-deleted", "tag": "c72abf78-d876-4b2c-8de8-12d16d44d3a0"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:03.371287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-ec0ac7e3-9913-44a8-a427-08bc173dcb7d req-a1947674-2360-4527-8532-210b889698c4 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:03.372462 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-ec0ac7e3-9913-44a8-a427-08bc173dcb7d req-a1947674-2360-4527-8532-210b889698c4 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:03.385976 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-ec0ac7e3-9913-44a8-a427-08bc173dcb7d req-a1947674-2360-4527-8532-210b889698c4 service nova] Creating event network-vif-deleted:c72abf78-d876-4b2c-8de8-12d16d44d3a0 for instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 on hv-cinder-83607 May 26 17:00:03.395533 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-ec0ac7e3-9913-44a8-a427-08bc173dcb7d req-a1947674-2360-4527-8532-210b889698c4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037353 May 26 17:00:03.397686 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 398/784] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:03.406921 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3496e639-656e-483b-97a5-9abb63a94240 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:03.407475 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3496e639-656e-483b-97a5-9abb63a94240 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:03.415244 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3496e639-656e-483b-97a5-9abb63a94240 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:03.421201 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3496e639-656e-483b-97a5-9abb63a94240 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:03.425057 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3496e639-656e-483b-97a5-9abb63a94240 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:03.425057 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3496e639-656e-483b-97a5-9abb63a94240 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:03.483119 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2a5f5486-493d-49cb-948f-270484b72dd9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:03.483834 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2a5f5486-493d-49cb-948f-270484b72dd9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:03.494059 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2a5f5486-493d-49cb-948f-270484b72dd9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:03.494551 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2a5f5486-493d-49cb-948f-270484b72dd9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:03.495338 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2a5f5486-493d-49cb-948f-270484b72dd9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:03.495780 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2a5f5486-493d-49cb-948f-270484b72dd9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:03.589387 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2a5f5486-493d-49cb-948f-270484b72dd9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:03.620340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3496e639-656e-483b-97a5-9abb63a94240 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:03.623095 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2a5f5486-493d-49cb-948f-270484b72dd9 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 200 len: 1615 microversion: 2.1 time: 0.144284 May 26 17:00:03.626082 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 399/785] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:03 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 1615 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:03.631593 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3496e639-656e-483b-97a5-9abb63a94240 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:03.634800 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3496e639-656e-483b-97a5-9abb63a94240 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:03.636085 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3496e639-656e-483b-97a5-9abb63a94240 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.238478 May 26 17:00:03.636877 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 387/786] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:03 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:04.644456 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3ded7b3c-4f47-4d8b-a3d0-5e2d588dd910 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:04.645208 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3ded7b3c-4f47-4d8b-a3d0-5e2d588dd910 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:04.652677 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3ded7b3c-4f47-4d8b-a3d0-5e2d588dd910 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:04.653364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3ded7b3c-4f47-4d8b-a3d0-5e2d588dd910 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:04.654293 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3ded7b3c-4f47-4d8b-a3d0-5e2d588dd910 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:04.654885 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3ded7b3c-4f47-4d8b-a3d0-5e2d588dd910 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:04.670263 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4372ed63-fe47-4e66-8607-2aa18fdff235 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:04.670685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-3ded7b3c-4f47-4d8b-a3d0-5e2d588dd910 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] HTTP exception thrown: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. May 26 17:00:04.670986 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4372ed63-fe47-4e66-8607-2aa18fdff235 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3ded7b3c-4f47-4d8b-a3d0-5e2d588dd910 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Request method failure captured: May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 HTTP/1.1 May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7DzbhltvfRlN11wtcZ5l_X_WvcTEIigXlOrGIiq9Yx6XlBxWNmzLmNABRCmLnPTr4rRVR4UaIBjMcSZhnziOK1SfjgVmtsWHcVwpG_z7xB0-B1QZy0o_2qrsjZYhxYRjwS8MjkCFlKcl1g60M7fXrlp400fuazE8HitBHbMDtgjELA May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:00:04.672984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:00:04.674368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_060af6cf4f7a48758f6859bd3766ae1b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/060af6cf4f7a48758f6859bd3766ae1b"}]}] May 26 17:00:04.674368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:00:04.674368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:00:04.674368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:00:04.674368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:00:04.674368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:00:04.674368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:00:04.674368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 1551f28754a64d1d9010ed90b67c5dc4 May 26 17:00:04.674368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:00:04.674368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:00:04.674368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. May 26 17:00:04.674368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3'} May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:00:04.675206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. May 26 17:00:04.677158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:00:04.678822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3ded7b3c-4f47-4d8b-a3d0-5e2d588dd910 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Returning 404 to user: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:00:04.678822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3ded7b3c-4f47-4d8b-a3d0-5e2d588dd910 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 404 len: 111 microversion: 2.1 time: 0.034972 May 26 17:00:04.678822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 400/787] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:04 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:00:04.682224 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4372ed63-fe47-4e66-8607-2aa18fdff235 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:04.682772 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4372ed63-fe47-4e66-8607-2aa18fdff235 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:04.683823 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4372ed63-fe47-4e66-8607-2aa18fdff235 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:04.684350 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2e2f1f33-f421-4f97-b84a-44c1affebb57 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '.version_select at 0x7fbe8033d1f0>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:04.684538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4372ed63-fe47-4e66-8607-2aa18fdff235 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:04.797782 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2e2f1f33-f421-4f97-b84a-44c1affebb57 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137858594" status: 202 len: 0 microversion: 2.1 time: 0.117601 May 26 17:00:04.798351 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 401/788] 10.222.0.48 () {58 vars in 1220 bytes} [Thu May 26 17:00:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137858594 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:00:04.823022 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4372ed63-fe47-4e66-8607-2aa18fdff235 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:04.832272 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4372ed63-fe47-4e66-8607-2aa18fdff235 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:04.833924 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4372ed63-fe47-4e66-8607-2aa18fdff235 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:04.835125 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4372ed63-fe47-4e66-8607-2aa18fdff235 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.180653 May 26 17:00:04.835700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 388/789] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:04 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:05.860719 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-21e17d5a-eb75-4cf7-9274-76e287387c0d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Action: 'create', calling method: .version_select at 0x7fbe8034e280>, body: {"keypair": {"name": "tempest-keypair-1825430007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4ttqh6sgIttCSfC1drNkPqkeG7yLmIVmBjK62yVseibsTO48i4M8ArWMIKOq99bIO6DrgwcWIfuLvnpts+ZLCyGuiVUfjNvW0LBK4a5mcUGM11kTqRKJl12ZIXav/4CQ=="}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:05.861186 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bb6fde44-f5a7-451e-9925-4f0f0768fe3a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:05.861186 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bb6fde44-f5a7-451e-9925-4f0f0768fe3a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:05.862665 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bb6fde44-f5a7-451e-9925-4f0f0768fe3a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:05.863125 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bb6fde44-f5a7-451e-9925-4f0f0768fe3a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:05.863928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bb6fde44-f5a7-451e-9925-4f0f0768fe3a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:05.864370 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bb6fde44-f5a7-451e-9925-4f0f0768fe3a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:05.868862 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-21e17d5a-eb75-4cf7-9274-76e287387c0d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'key_pairs'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:00:05.873783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-21e17d5a-eb75-4cf7-9274-76e287387c0d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for user 1551f28754a64d1d9010ed90b67c5dc4 and project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'key_pairs'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:00:06.003608 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-21e17d5a-eb75-4cf7-9274-76e287387c0d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158240 May 26 17:00:06.004310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 402/790] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 26 17:00:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:06.009453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bb6fde44-f5a7-451e-9925-4f0f0768fe3a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:06.026618 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bb6fde44-f5a7-451e-9925-4f0f0768fe3a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:06.026618 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bb6fde44-f5a7-451e-9925-4f0f0768fe3a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:06.026618 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bb6fde44-f5a7-451e-9925-4f0f0768fe3a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.171753 May 26 17:00:06.027202 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 389/791] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:05 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:06.651950 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f74897ef-a07a-47c7-8d31-da8cdad51b4d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:06.652447 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f74897ef-a07a-47c7-8d31-da8cdad51b4d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:06.659015 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f74897ef-a07a-47c7-8d31-da8cdad51b4d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:06.659466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f74897ef-a07a-47c7-8d31-da8cdad51b4d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:06.660241 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f74897ef-a07a-47c7-8d31-da8cdad51b4d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:06.660674 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f74897ef-a07a-47c7-8d31-da8cdad51b4d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:06.685940 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f74897ef-a07a-47c7-8d31-da8cdad51b4d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Going to try to terminate instance {{(pid=124836) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:00:07.040268 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b1a4c930-99f7-443c-9eea-ad8ad43fb01f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:07.043502 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b1a4c930-99f7-443c-9eea-ad8ad43fb01f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:07.048658 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b1a4c930-99f7-443c-9eea-ad8ad43fb01f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:07.048970 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b1a4c930-99f7-443c-9eea-ad8ad43fb01f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:07.049770 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b1a4c930-99f7-443c-9eea-ad8ad43fb01f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:07.050225 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b1a4c930-99f7-443c-9eea-ad8ad43fb01f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:07.065983 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f74897ef-a07a-47c7-8d31-da8cdad51b4d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "DELETE /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 204 len: 0 microversion: 2.1 time: 0.417148 May 26 17:00:07.067635 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 403/792] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:00:06 2022] DELETE /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:00:07.077221 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-eee4e954-f3cc-46b9-b6d7-f7d0780af1ee tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:07.078166 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-eee4e954-f3cc-46b9-b6d7-f7d0780af1ee tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:07.084749 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eee4e954-f3cc-46b9-b6d7-f7d0780af1ee tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:07.085197 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eee4e954-f3cc-46b9-b6d7-f7d0780af1ee tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:07.086134 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eee4e954-f3cc-46b9-b6d7-f7d0780af1ee tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:07.086579 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eee4e954-f3cc-46b9-b6d7-f7d0780af1ee tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:07.292358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b1a4c930-99f7-443c-9eea-ad8ad43fb01f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:07.301561 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b1a4c930-99f7-443c-9eea-ad8ad43fb01f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:07.303081 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b1a4c930-99f7-443c-9eea-ad8ad43fb01f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:07.304330 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b1a4c930-99f7-443c-9eea-ad8ad43fb01f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.268212 May 26 17:00:07.304884 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 390/793] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:07 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:00:07.306280 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-eee4e954-f3cc-46b9-b6d7-f7d0780af1ee tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:07.315191 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-eee4e954-f3cc-46b9-b6d7-f7d0780af1ee tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1577 microversion: 2.1 time: 0.243373 May 26 17:00:07.315786 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 404/794] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:07 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1577 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:08.322852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3e56757a-ffac-4ca9-9daf-2989a64748a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:08.323759 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3e56757a-ffac-4ca9-9daf-2989a64748a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:08.332941 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3b2d942d-3b6a-4b9a-ad7f-e6f78046e78c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:08.333619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3b2d942d-3b6a-4b9a-ad7f-e6f78046e78c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:08.340974 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e56757a-ffac-4ca9-9daf-2989a64748a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:08.341478 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e56757a-ffac-4ca9-9daf-2989a64748a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:08.341813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3b2d942d-3b6a-4b9a-ad7f-e6f78046e78c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:08.342274 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e56757a-ffac-4ca9-9daf-2989a64748a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:08.342466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3b2d942d-3b6a-4b9a-ad7f-e6f78046e78c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:08.342751 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3e56757a-ffac-4ca9-9daf-2989a64748a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:08.343405 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3b2d942d-3b6a-4b9a-ad7f-e6f78046e78c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:08.344098 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3b2d942d-3b6a-4b9a-ad7f-e6f78046e78c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:08.362592 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:08.584863 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3e56757a-ffac-4ca9-9daf-2989a64748a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:08.594182 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3e56757a-ffac-4ca9-9daf-2989a64748a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:08.595829 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3e56757a-ffac-4ca9-9daf-2989a64748a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:08.597320 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3e56757a-ffac-4ca9-9daf-2989a64748a1 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.278405 May 26 17:00:08.598067 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 391/795] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:08 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:08.632494 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3b2d942d-3b6a-4b9a-ad7f-e6f78046e78c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:08.642881 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3b2d942d-3b6a-4b9a-ad7f-e6f78046e78c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1577 microversion: 2.1 time: 0.313704 May 26 17:00:08.643473 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 405/796] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:08 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1577 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:08.884845 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-269446501", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f04a253f-94d5-469e-a169-e4789fc9cd70"}], "security_groups": [{"name": "tempest-securitygroup--1528213796"}], "key_name": "tempest-keypair-1825430007", "user_data": "}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:08.990072 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] validate_networks() for [('f04a253f-94d5-469e-a169-e4789fc9cd70', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:00:09.402768 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:00:09.403401 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:00:09.403737 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:00:09.404164 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:00:09.404647 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:00:09.414891 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:09.415349 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:09.416408 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:09.416925 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:09.434981 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:00:09.439393 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Getting quotas for user 1551f28754a64d1d9010ed90b67c5dc4 and project 060af6cf4f7a48758f6859bd3766ae1b. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:00:09.451327 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:00:09.454361 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:00:09.598549 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5f40ea44-491a-493a-b634-5d9d742dbd35 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.717862 May 26 17:00:09.599770 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 392/797] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 17:00:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 17:00:09.610444 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3afdcb76-f699-40f6-8ddc-60f0184148c8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:09.611046 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3afdcb76-f699-40f6-8ddc-60f0184148c8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:09.619720 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-23c39b97-985f-428f-be1a-608f13295c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:09.620486 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-23c39b97-985f-428f-be1a-608f13295c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:09.628117 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-23c39b97-985f-428f-be1a-608f13295c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:09.628662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-23c39b97-985f-428f-be1a-608f13295c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:09.629633 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-23c39b97-985f-428f-be1a-608f13295c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:09.630142 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-23c39b97-985f-428f-be1a-608f13295c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:09.671631 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3afdcb76-f699-40f6-8ddc-60f0184148c8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:09.680809 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3afdcb76-f699-40f6-8ddc-60f0184148c8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1241 microversion: 2.1 time: 0.074541 May 26 17:00:09.681673 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 406/798] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:09 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:09.699810 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8a6a1303-3f97-4c55-86cb-02e43b49a69e tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:09.700659 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8a6a1303-3f97-4c55-86cb-02e43b49a69e tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:09.712488 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8a6a1303-3f97-4c55-86cb-02e43b49a69e tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:09.713144 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8a6a1303-3f97-4c55-86cb-02e43b49a69e tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:09.714122 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8a6a1303-3f97-4c55-86cb-02e43b49a69e tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:09.714721 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8a6a1303-3f97-4c55-86cb-02e43b49a69e tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:09.721435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:09.812106 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8a6a1303-3f97-4c55-86cb-02e43b49a69e tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:09.825713 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8a6a1303-3f97-4c55-86cb-02e43b49a69e tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1509 microversion: 2.1 time: 0.128189 May 26 17:00:09.826633 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 407/799] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:09 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1509 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:09.866015 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-23c39b97-985f-428f-be1a-608f13295c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:09.874554 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-23c39b97-985f-428f-be1a-608f13295c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:09.876825 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-23c39b97-985f-428f-be1a-608f13295c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:09.878047 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-23c39b97-985f-428f-be1a-608f13295c41 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.262380 May 26 17:00:09.878618 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 393/800] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:09 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:10.121727 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-33f7b0a4-9b5c-4760-9e26-c849a60c3d13 req-e0142087-52a5-46a7-9c37-4ead3229c527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69fcc029-dd46-485e-8058-9d577bb0e654", "name": "network-vif-deleted", "tag": "a919d060-6065-426c-982a-0881dca96a38"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:10.158188 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-33f7b0a4-9b5c-4760-9e26-c849a60c3d13 req-e0142087-52a5-46a7-9c37-4ead3229c527 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:10.158789 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-33f7b0a4-9b5c-4760-9e26-c849a60c3d13 req-e0142087-52a5-46a7-9c37-4ead3229c527 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:10.182502 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-33f7b0a4-9b5c-4760-9e26-c849a60c3d13 req-e0142087-52a5-46a7-9c37-4ead3229c527 service nova] Creating event network-vif-deleted:a919d060-6065-426c-982a-0881dca96a38 for instance 69fcc029-dd46-485e-8058-9d577bb0e654 on hv-cinder-83607 May 26 17:00:10.196163 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-33f7b0a4-9b5c-4760-9e26-c849a60c3d13 req-e0142087-52a5-46a7-9c37-4ead3229c527 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076058 May 26 17:00:10.197135 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 408/801] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:10.700097 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0c2f7d3d-c5a7-4de1-9c29-f4ad422bfa77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:10.700725 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0c2f7d3d-c5a7-4de1-9c29-f4ad422bfa77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:10.710430 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0c2f7d3d-c5a7-4de1-9c29-f4ad422bfa77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:10.710887 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0c2f7d3d-c5a7-4de1-9c29-f4ad422bfa77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:10.711740 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0c2f7d3d-c5a7-4de1-9c29-f4ad422bfa77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:10.712197 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0c2f7d3d-c5a7-4de1-9c29-f4ad422bfa77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:10.789405 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0c2f7d3d-c5a7-4de1-9c29-f4ad422bfa77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:10.802470 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0c2f7d3d-c5a7-4de1-9c29-f4ad422bfa77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1245 microversion: 2.1 time: 0.104842 May 26 17:00:10.813163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 394/802] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:10 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1245 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:10.846274 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9c953afe-5604-4016-b8ce-5d56dec117fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:10.847072 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9c953afe-5604-4016-b8ce-5d56dec117fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:10.855226 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9c953afe-5604-4016-b8ce-5d56dec117fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:10.855986 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9c953afe-5604-4016-b8ce-5d56dec117fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:10.856772 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9c953afe-5604-4016-b8ce-5d56dec117fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:10.857219 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9c953afe-5604-4016-b8ce-5d56dec117fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:10.909342 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d08599ed-8ac7-4c3f-a291-b47d37c54135 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:10.909342 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d08599ed-8ac7-4c3f-a291-b47d37c54135 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:10.909342 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d08599ed-8ac7-4c3f-a291-b47d37c54135 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:10.909342 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d08599ed-8ac7-4c3f-a291-b47d37c54135 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:10.910325 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d08599ed-8ac7-4c3f-a291-b47d37c54135 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:10.910325 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d08599ed-8ac7-4c3f-a291-b47d37c54135 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:10.930247 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9c953afe-5604-4016-b8ce-5d56dec117fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:10.940805 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9c953afe-5604-4016-b8ce-5d56dec117fc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 200 len: 1225 microversion: 2.1 time: 0.099952 May 26 17:00:10.942929 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 409/803] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:10 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:11.071994 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d08599ed-8ac7-4c3f-a291-b47d37c54135 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:11.082512 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d08599ed-8ac7-4c3f-a291-b47d37c54135 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:11.084055 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d08599ed-8ac7-4c3f-a291-b47d37c54135 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:11.085295 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d08599ed-8ac7-4c3f-a291-b47d37c54135 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.193010 May 26 17:00:11.089933 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 395/804] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:10 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:11.820857 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-92672787-294d-4029-beb6-976237435e3b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:11.821720 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-92672787-294d-4029-beb6-976237435e3b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:11.828830 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-92672787-294d-4029-beb6-976237435e3b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:11.829491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-92672787-294d-4029-beb6-976237435e3b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:11.830485 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-92672787-294d-4029-beb6-976237435e3b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:11.831008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-92672787-294d-4029-beb6-976237435e3b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:11.900734 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-92672787-294d-4029-beb6-976237435e3b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:11.909348 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-92672787-294d-4029-beb6-976237435e3b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1293 microversion: 2.1 time: 0.093148 May 26 17:00:11.910001 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 410/805] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:11 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:11.959260 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-18bdd176-5ef4-43de-90b6-800126415d80 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:11.959887 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-18bdd176-5ef4-43de-90b6-800126415d80 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:11.966568 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-18bdd176-5ef4-43de-90b6-800126415d80 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:11.967054 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-18bdd176-5ef4-43de-90b6-800126415d80 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:11.967813 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-18bdd176-5ef4-43de-90b6-800126415d80 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:11.968266 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-18bdd176-5ef4-43de-90b6-800126415d80 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:11.984746 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-18bdd176-5ef4-43de-90b6-800126415d80 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] HTTP exception thrown: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-18bdd176-5ef4-43de-90b6-800126415d80 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Request method failure captured: May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 HTTP/1.1 May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7EqciG3FVPmYaBNltgAFOUknoo_IVWHg0H6qRq7PSAbK6DiazlnULhaRQpohntaLGBnsGJxU0v2uZ6GGVb9R9IUbfCURkBMOhn2UFTS_rtBh1lfwbMLXSNAtDPm69PNeDqvc85E69vfIGqZr_dmARy4HR6y48bWk6cwj_8hAxoqMis May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 895a592d480548ddb6afdb1e7c45ed92 May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-TestVolumeBootPattern-1663250540 May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:00:11.986453 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:00:11.987978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/895a592d480548ddb6afdb1e7c45ed92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/895a592d480548ddb6afdb1e7c45ed92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_895a592d480548ddb6afdb1e7c45ed92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/895a592d480548ddb6afdb1e7c45ed92"}]}] May 26 17:00:11.987978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-TestVolumeBootPattern-1663250540 May 26 17:00:11.987978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 895a592d480548ddb6afdb1e7c45ed92 May 26 17:00:11.987978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-TestVolumeBootPattern-1663250540 May 26 17:00:11.987978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-TestVolumeBootPattern-1663250540-project May 26 17:00:11.987978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:00:11.987978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:00:11.987978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: 5d6ddab73db44710bcb5bba4c0cfbcfa May 26 17:00:11.987978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-TestVolumeBootPattern-1663250540-project May 26 17:00:11.987978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 17:00:11.987978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. May 26 17:00:11.987978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': '69fcc029-dd46-485e-8058-9d577bb0e654'} May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:00:11.988901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. May 26 17:00:11.990449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:00:11.991729 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-18bdd176-5ef4-43de-90b6-800126415d80 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Returning 404 to user: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:00:11.991729 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-18bdd176-5ef4-43de-90b6-800126415d80 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 404 len: 111 microversion: 2.1 time: 0.032550 May 26 17:00:11.991729 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 396/806] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:11 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:00:12.091956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1136964128", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-787864708", "security_groups": [{"name": "tempest-secgroup-smoke-1078549195"}], "block_device_mapping_v2": [{"uuid": "bbc99099-1fcf-4fa6-9b2c-709191d7fd22", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3b72a37f-f6f4-40d5-aa2f-177110f74e30"}]}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:12.104857 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e1ee93f7-7964-4577-a2fc-2f5def85c8e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:12.105878 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e1ee93f7-7964-4577-a2fc-2f5def85c8e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:12.122838 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1ee93f7-7964-4577-a2fc-2f5def85c8e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:12.123547 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1ee93f7-7964-4577-a2fc-2f5def85c8e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:12.124587 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1ee93f7-7964-4577-a2fc-2f5def85c8e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:12.126293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e1ee93f7-7964-4577-a2fc-2f5def85c8e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:12.252506 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.network.neutron [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] validate_networks() for [('3b72a37f-f6f4-40d5-aa2f-177110f74e30', None, None, None, None, None)] {{(pid=124836) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:00:12.356832 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e1ee93f7-7964-4577-a2fc-2f5def85c8e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:12.366248 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e1ee93f7-7964-4577-a2fc-2f5def85c8e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:12.367868 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e1ee93f7-7964-4577-a2fc-2f5def85c8e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:12.369214 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e1ee93f7-7964-4577-a2fc-2f5def85c8e4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.268405 May 26 17:00:12.369896 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 397/807] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:12 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:12.712271 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Flavor limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:00:12.712700 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Image limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:00:12.713188 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Flavor pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:00:12.713635 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Image pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:00:12.714051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:00:12.725106 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:12.725587 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:12.726405 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:12.726849 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:12.744432 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Getting quotas for project 895a592d480548ddb6afdb1e7c45ed92. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:00:12.748469 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Getting quotas for user 5d6ddab73db44710bcb5bba4c0cfbcfa and project 895a592d480548ddb6afdb1e7c45ed92. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:00:12.813427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Going to run 1 instances... {{(pid=124836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:00:12.814412 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bbc99099-1fcf-4fa6-9b2c-709191d7fd22',volume_size=None,volume_type=None)] {{(pid=124836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:00:12.926772 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-32378e3b-2aae-4dee-a012-d65d5c67e0cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:12.927398 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-32378e3b-2aae-4dee-a012-d65d5c67e0cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:12.933588 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32378e3b-2aae-4dee-a012-d65d5c67e0cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:12.934050 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32378e3b-2aae-4dee-a012-d65d5c67e0cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:12.934825 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32378e3b-2aae-4dee-a012-d65d5c67e0cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:12.935290 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-32378e3b-2aae-4dee-a012-d65d5c67e0cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:13.001341 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-32378e3b-2aae-4dee-a012-d65d5c67e0cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:13.009657 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-32378e3b-2aae-4dee-a012-d65d5c67e0cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1299 microversion: 2.1 time: 0.086807 May 26 17:00:13.010233 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 398/808] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:12 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:13.281122 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2e0fcb85-490e-4a9f-9d4f-91f814646b10 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.193098 May 26 17:00:13.289186 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 411/809] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 17:00:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 17:00:13.294804 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d26bfc5c-f4fa-4fc3-a0ae-cd480a022530 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:13.295587 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d26bfc5c-f4fa-4fc3-a0ae-cd480a022530 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:13.370651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d26bfc5c-f4fa-4fc3-a0ae-cd480a022530 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:13.378461 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d26bfc5c-f4fa-4fc3-a0ae-cd480a022530 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1094 microversion: 2.1 time: 0.087834 May 26 17:00:13.379044 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 399/810] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:13 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1094 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:13.392649 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-69253c7e-911a-4c0a-a6ff-f5094a1da70d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:13.395146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-69253c7e-911a-4c0a-a6ff-f5094a1da70d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:13.415210 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69253c7e-911a-4c0a-a6ff-f5094a1da70d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:13.415210 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69253c7e-911a-4c0a-a6ff-f5094a1da70d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:13.415210 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69253c7e-911a-4c0a-a6ff-f5094a1da70d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:13.415210 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69253c7e-911a-4c0a-a6ff-f5094a1da70d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:13.591155 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-69253c7e-911a-4c0a-a6ff-f5094a1da70d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:13.603650 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-69253c7e-911a-4c0a-a6ff-f5094a1da70d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:13.615821 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-69253c7e-911a-4c0a-a6ff-f5094a1da70d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:13.623108 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-69253c7e-911a-4c0a-a6ff-f5094a1da70d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.239079 May 26 17:00:13.635036 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 412/811] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:13 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:14.028134 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cd3adade-6303-4084-a2e7-26e6b9c5eb1e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:14.028756 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cd3adade-6303-4084-a2e7-26e6b9c5eb1e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:14.036644 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cd3adade-6303-4084-a2e7-26e6b9c5eb1e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:14.037090 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cd3adade-6303-4084-a2e7-26e6b9c5eb1e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:14.037906 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cd3adade-6303-4084-a2e7-26e6b9c5eb1e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:14.038349 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cd3adade-6303-4084-a2e7-26e6b9c5eb1e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:14.216032 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-cd3adade-6303-4084-a2e7-26e6b9c5eb1e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:14.226891 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cd3adade-6303-4084-a2e7-26e6b9c5eb1e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1367 microversion: 2.1 time: 0.202550 May 26 17:00:14.227497 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 400/812] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:14 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:14.395720 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ea0e1362-6959-4543-8154-1a525a51de01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:14.396281 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ea0e1362-6959-4543-8154-1a525a51de01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:14.403167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ea0e1362-6959-4543-8154-1a525a51de01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:14.403621 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ea0e1362-6959-4543-8154-1a525a51de01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:14.404430 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ea0e1362-6959-4543-8154-1a525a51de01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:14.404874 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ea0e1362-6959-4543-8154-1a525a51de01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:14.475229 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ea0e1362-6959-4543-8154-1a525a51de01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:14.485146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ea0e1362-6959-4543-8154-1a525a51de01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1144 microversion: 2.1 time: 0.091650 May 26 17:00:14.485146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 413/813] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:14 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:14.571988 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-fce698c0-ba80-44c0-b48c-fc1c3af7dcc4 req-b70993cb-56e8-405f-b991-e3f0b9a055e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e68f0d-86ed-4e9d-8bb9-06ca9638e690", "tag": "5cdaad96-644e-4293-96b8-914e68d08378"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:14.581169 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-fce698c0-ba80-44c0-b48c-fc1c3af7dcc4 req-b70993cb-56e8-405f-b991-e3f0b9a055e9 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:14.581605 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-fce698c0-ba80-44c0-b48c-fc1c3af7dcc4 req-b70993cb-56e8-405f-b991-e3f0b9a055e9 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:14.594625 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-fce698c0-ba80-44c0-b48c-fc1c3af7dcc4 req-b70993cb-56e8-405f-b991-e3f0b9a055e9 service nova] Creating event network-changed:5cdaad96-644e-4293-96b8-914e68d08378 for instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 on hv-cinder-83607 May 26 17:00:14.607275 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-fce698c0-ba80-44c0-b48c-fc1c3af7dcc4 req-b70993cb-56e8-405f-b991-e3f0b9a055e9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038953 May 26 17:00:14.616617 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 401/814] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:14.652508 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4dd59f6d-6083-427a-a852-30c9078fda1d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:14.658355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4dd59f6d-6083-427a-a852-30c9078fda1d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:14.660817 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4dd59f6d-6083-427a-a852-30c9078fda1d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:14.661300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4dd59f6d-6083-427a-a852-30c9078fda1d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:14.662148 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4dd59f6d-6083-427a-a852-30c9078fda1d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:14.662577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4dd59f6d-6083-427a-a852-30c9078fda1d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:14.814382 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4dd59f6d-6083-427a-a852-30c9078fda1d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:14.825549 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4dd59f6d-6083-427a-a852-30c9078fda1d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:14.826999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4dd59f6d-6083-427a-a852-30c9078fda1d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:14.830940 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4dd59f6d-6083-427a-a852-30c9078fda1d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1743 microversion: 2.20 time: 0.192351 May 26 17:00:14.831513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 414/815] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:14 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1743 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:15.429384 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a6d37d31-04b9-4f71-939a-6f97df70ae7f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:15.430039 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a6d37d31-04b9-4f71-939a-6f97df70ae7f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:15.437723 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a6d37d31-04b9-4f71-939a-6f97df70ae7f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:15.438191 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a6d37d31-04b9-4f71-939a-6f97df70ae7f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:15.438977 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a6d37d31-04b9-4f71-939a-6f97df70ae7f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:15.439412 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a6d37d31-04b9-4f71-939a-6f97df70ae7f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:15.502068 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4f6cb9b3-1480-4a15-a52c-28ca3d467574 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:15.502754 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4f6cb9b3-1480-4a15-a52c-28ca3d467574 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:15.509645 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4f6cb9b3-1480-4a15-a52c-28ca3d467574 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:15.510146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4f6cb9b3-1480-4a15-a52c-28ca3d467574 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:15.510881 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4f6cb9b3-1480-4a15-a52c-28ca3d467574 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:15.511347 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4f6cb9b3-1480-4a15-a52c-28ca3d467574 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:15.592815 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4f6cb9b3-1480-4a15-a52c-28ca3d467574 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:15.601653 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4f6cb9b3-1480-4a15-a52c-28ca3d467574 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1192 microversion: 2.1 time: 0.104244 May 26 17:00:15.611985 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 415/816] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:15 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1192 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:15.612512 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a6d37d31-04b9-4f71-939a-6f97df70ae7f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:15.614025 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a6d37d31-04b9-4f71-939a-6f97df70ae7f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1367 microversion: 2.1 time: 0.373724 May 26 17:00:15.614700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 402/817] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:15 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1367 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:15.850976 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9b509b95-da3d-4567-a33b-061a0b15fb12 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:15.851729 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9b509b95-da3d-4567-a33b-061a0b15fb12 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:15.863309 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b509b95-da3d-4567-a33b-061a0b15fb12 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:15.864016 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b509b95-da3d-4567-a33b-061a0b15fb12 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:15.868785 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b509b95-da3d-4567-a33b-061a0b15fb12 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:15.868785 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9b509b95-da3d-4567-a33b-061a0b15fb12 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:16.029432 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9b509b95-da3d-4567-a33b-061a0b15fb12 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:16.038586 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9b509b95-da3d-4567-a33b-061a0b15fb12 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:16.040224 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9b509b95-da3d-4567-a33b-061a0b15fb12 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:16.041517 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9b509b95-da3d-4567-a33b-061a0b15fb12 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1743 microversion: 2.20 time: 0.194883 May 26 17:00:16.042192 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 416/818] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:15 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1743 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:16.619835 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5375158e-98ef-410a-91dc-39eaa6973022 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:16.620474 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5375158e-98ef-410a-91dc-39eaa6973022 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:16.627328 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5375158e-98ef-410a-91dc-39eaa6973022 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:16.627778 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5375158e-98ef-410a-91dc-39eaa6973022 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:16.628561 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5375158e-98ef-410a-91dc-39eaa6973022 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:16.629078 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5375158e-98ef-410a-91dc-39eaa6973022 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:16.630858 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-682dfae5-00a0-4c57-b765-3c291edd7613 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:16.631471 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-682dfae5-00a0-4c57-b765-3c291edd7613 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:16.637594 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-682dfae5-00a0-4c57-b765-3c291edd7613 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:16.638051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-682dfae5-00a0-4c57-b765-3c291edd7613 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:16.638910 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-682dfae5-00a0-4c57-b765-3c291edd7613 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:16.639331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-682dfae5-00a0-4c57-b765-3c291edd7613 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:16.704586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5375158e-98ef-410a-91dc-39eaa6973022 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:16.712342 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5375158e-98ef-410a-91dc-39eaa6973022 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1200 microversion: 2.1 time: 0.096421 May 26 17:00:16.712923 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 403/819] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:16 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1200 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:16.788633 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-682dfae5-00a0-4c57-b765-3c291edd7613 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:16.796144 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-682dfae5-00a0-4c57-b765-3c291edd7613 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1367 microversion: 2.1 time: 0.169123 May 26 17:00:16.796745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 417/820] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:16 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:17.060419 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f304d7d8-8629-42e9-9480-9ddf167cc0de tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:17.061040 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f304d7d8-8629-42e9-9480-9ddf167cc0de tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:17.068026 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f304d7d8-8629-42e9-9480-9ddf167cc0de tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:17.068492 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f304d7d8-8629-42e9-9480-9ddf167cc0de tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:17.069387 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f304d7d8-8629-42e9-9480-9ddf167cc0de tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:17.069840 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f304d7d8-8629-42e9-9480-9ddf167cc0de tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:17.202845 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f304d7d8-8629-42e9-9480-9ddf167cc0de tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:17.211676 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f304d7d8-8629-42e9-9480-9ddf167cc0de tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:17.213190 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f304d7d8-8629-42e9-9480-9ddf167cc0de tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:17.214380 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f304d7d8-8629-42e9-9480-9ddf167cc0de tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1743 microversion: 2.20 time: 0.158306 May 26 17:00:17.217156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 404/821] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:17 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:17.730596 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-21709e34-4a9a-4b21-be6d-6b9517517246 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:17.731198 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-21709e34-4a9a-4b21-be6d-6b9517517246 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:17.738328 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-21709e34-4a9a-4b21-be6d-6b9517517246 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:17.738782 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-21709e34-4a9a-4b21-be6d-6b9517517246 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:17.739556 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-21709e34-4a9a-4b21-be6d-6b9517517246 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:17.739997 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-21709e34-4a9a-4b21-be6d-6b9517517246 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:17.800903 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-21709e34-4a9a-4b21-be6d-6b9517517246 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:17.808523 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-21709e34-4a9a-4b21-be6d-6b9517517246 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1200 microversion: 2.1 time: 0.081738 May 26 17:00:17.809084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 418/822] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:17 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1200 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:17.814021 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3260035d-acc9-4a22-8208-272795fd3b7a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:17.814629 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3260035d-acc9-4a22-8208-272795fd3b7a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:17.817161 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:17.822161 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3260035d-acc9-4a22-8208-272795fd3b7a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:17.822604 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3260035d-acc9-4a22-8208-272795fd3b7a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:17.823382 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3260035d-acc9-4a22-8208-272795fd3b7a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:17.823824 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3260035d-acc9-4a22-8208-272795fd3b7a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:17.960534 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3260035d-acc9-4a22-8208-272795fd3b7a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:17.968007 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3260035d-acc9-4a22-8208-272795fd3b7a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1367 microversion: 2.1 time: 0.158504 May 26 17:00:17.969070 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 405/823] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:17 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:18.233642 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-52eb5c9c-ff53-4a2c-919e-6bdeb1af33ad tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:18.234881 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-52eb5c9c-ff53-4a2c-919e-6bdeb1af33ad tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:18.240938 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-52eb5c9c-ff53-4a2c-919e-6bdeb1af33ad tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:18.241422 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-52eb5c9c-ff53-4a2c-919e-6bdeb1af33ad tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:18.242180 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-52eb5c9c-ff53-4a2c-919e-6bdeb1af33ad tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:18.242619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-52eb5c9c-ff53-4a2c-919e-6bdeb1af33ad tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:18.371127 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-52eb5c9c-ff53-4a2c-919e-6bdeb1af33ad tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:18.379842 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-52eb5c9c-ff53-4a2c-919e-6bdeb1af33ad tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:18.381484 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-52eb5c9c-ff53-4a2c-919e-6bdeb1af33ad tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:18.382699 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-52eb5c9c-ff53-4a2c-919e-6bdeb1af33ad tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1743 microversion: 2.20 time: 0.153015 May 26 17:00:18.383260 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 419/824] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:18 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:18.738715 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7f1c38c4-a7a8-48eb-bd93-c67f1a6fc329 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:18.739208 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7f1c38c4-a7a8-48eb-bd93-c67f1a6fc329 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:18.745226 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7f1c38c4-a7a8-48eb-bd93-c67f1a6fc329 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:18.745704 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7f1c38c4-a7a8-48eb-bd93-c67f1a6fc329 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:18.746449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7f1c38c4-a7a8-48eb-bd93-c67f1a6fc329 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:18.746881 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7f1c38c4-a7a8-48eb-bd93-c67f1a6fc329 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:18.769140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7f1c38c4-a7a8-48eb-bd93-c67f1a6fc329 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/ips" status: 200 len: 147 microversion: 2.1 time: 0.034964 May 26 17:00:18.769721 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 406/825] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 26 17:00:18 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/ips => generated 147 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:18.825957 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-89a287b6-95fc-49af-a6d0-df0177c35a18 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:18.826577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-89a287b6-95fc-49af-a6d0-df0177c35a18 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:18.834198 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-89a287b6-95fc-49af-a6d0-df0177c35a18 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:18.835307 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-89a287b6-95fc-49af-a6d0-df0177c35a18 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:18.836081 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-89a287b6-95fc-49af-a6d0-df0177c35a18 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:18.836526 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-89a287b6-95fc-49af-a6d0-df0177c35a18 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:18.899435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-89a287b6-95fc-49af-a6d0-df0177c35a18 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:18.907657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-89a287b6-95fc-49af-a6d0-df0177c35a18 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1200 microversion: 2.1 time: 0.085459 May 26 17:00:18.908458 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 420/826] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:18 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1200 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:18.987606 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-054e9b3b-8f1e-4a17-a2dd-b61544bd13c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:18.988248 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-054e9b3b-8f1e-4a17-a2dd-b61544bd13c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:18.997384 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-054e9b3b-8f1e-4a17-a2dd-b61544bd13c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:18.997384 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-054e9b3b-8f1e-4a17-a2dd-b61544bd13c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:18.997384 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-054e9b3b-8f1e-4a17-a2dd-b61544bd13c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:18.997384 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-054e9b3b-8f1e-4a17-a2dd-b61544bd13c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:19.132924 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-054e9b3b-8f1e-4a17-a2dd-b61544bd13c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:19.141438 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-054e9b3b-8f1e-4a17-a2dd-b61544bd13c5 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1367 microversion: 2.1 time: 0.159847 May 26 17:00:19.142377 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 407/827] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:18 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:19.406840 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b65c14de-bbae-4b25-8be3-0ef67654363a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:19.407377 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b65c14de-bbae-4b25-8be3-0ef67654363a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:19.410647 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:19.414376 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b65c14de-bbae-4b25-8be3-0ef67654363a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:19.418427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b65c14de-bbae-4b25-8be3-0ef67654363a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:19.418427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b65c14de-bbae-4b25-8be3-0ef67654363a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:19.418427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b65c14de-bbae-4b25-8be3-0ef67654363a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:19.556695 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b65c14de-bbae-4b25-8be3-0ef67654363a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:19.583485 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-fccd72b4-3e18-4a99-98ae-e95409217226 req-aaa17c3e-4b86-4b7e-aa18-faf7d830512d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ca388b-87f7-46b3-81f0-5e7d06e9dcc1", "name": "network-vif-plugged", "status": "completed", "tag": "17153ebf-8de6-4b1d-bafd-f2c2e8580998"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:19.583838 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b65c14de-bbae-4b25-8be3-0ef67654363a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:19.583977 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:19.584085 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b65c14de-bbae-4b25-8be3-0ef67654363a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:19.584085 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b65c14de-bbae-4b25-8be3-0ef67654363a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1743 microversion: 2.20 time: 0.172559 May 26 17:00:19.584085 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 421/828] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:19 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:19.584357 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-fccd72b4-3e18-4a99-98ae-e95409217226 req-aaa17c3e-4b86-4b7e-aa18-faf7d830512d service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:19.584357 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-fccd72b4-3e18-4a99-98ae-e95409217226 req-aaa17c3e-4b86-4b7e-aa18-faf7d830512d service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:19.589790 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-fccd72b4-3e18-4a99-98ae-e95409217226 req-aaa17c3e-4b86-4b7e-aa18-faf7d830512d service nova] Creating event network-vif-plugged:17153ebf-8de6-4b1d-bafd-f2c2e8580998 for instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 on hv-cinder-83607 May 26 17:00:19.594792 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-fccd72b4-3e18-4a99-98ae-e95409217226 req-aaa17c3e-4b86-4b7e-aa18-faf7d830512d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033598 May 26 17:00:19.595378 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 408/829] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:00:19.925564 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3204f902-2e84-47f8-95ae-a89e1c5dc2e4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:19.926174 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3204f902-2e84-47f8-95ae-a89e1c5dc2e4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:19.935095 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3204f902-2e84-47f8-95ae-a89e1c5dc2e4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:19.940590 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3204f902-2e84-47f8-95ae-a89e1c5dc2e4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:19.940590 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3204f902-2e84-47f8-95ae-a89e1c5dc2e4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:19.940590 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3204f902-2e84-47f8-95ae-a89e1c5dc2e4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:20.015251 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3204f902-2e84-47f8-95ae-a89e1c5dc2e4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:20.025450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3204f902-2e84-47f8-95ae-a89e1c5dc2e4 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1200 microversion: 2.1 time: 0.104311 May 26 17:00:20.035814 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 422/830] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:19 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1200 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:20.167950 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-110d48eb-b32d-410e-a463-6666eee21c74 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:20.168735 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-110d48eb-b32d-410e-a463-6666eee21c74 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:20.179218 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-110d48eb-b32d-410e-a463-6666eee21c74 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:20.179672 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-110d48eb-b32d-410e-a463-6666eee21c74 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:20.181031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-110d48eb-b32d-410e-a463-6666eee21c74 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:20.181760 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-110d48eb-b32d-410e-a463-6666eee21c74 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:20.368843 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-110d48eb-b32d-410e-a463-6666eee21c74 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:20.376937 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-110d48eb-b32d-410e-a463-6666eee21c74 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1367 microversion: 2.1 time: 0.220100 May 26 17:00:20.377553 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 409/831] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:20 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:20.503375 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-12648459-1171-45e0-a5bb-0207f7709128 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a442e33c-4ba9-45dc-ae01-56025f4187e7"}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:20.504759 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-12648459-1171-45e0-a5bb-0207f7709128 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:20.516561 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-12648459-1171-45e0-a5bb-0207f7709128 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:20.516561 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-12648459-1171-45e0-a5bb-0207f7709128 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:20.516561 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-12648459-1171-45e0-a5bb-0207f7709128 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:20.516561 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-12648459-1171-45e0-a5bb-0207f7709128 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:20.591533 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5bad6c9e-b03c-442c-9b49-b6af45e84304 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:20.592587 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5bad6c9e-b03c-442c-9b49-b6af45e84304 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:20.600031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5bad6c9e-b03c-442c-9b49-b6af45e84304 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:20.600492 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5bad6c9e-b03c-442c-9b49-b6af45e84304 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:20.601504 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5bad6c9e-b03c-442c-9b49-b6af45e84304 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:20.602213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5bad6c9e-b03c-442c-9b49-b6af45e84304 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:20.764217 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5bad6c9e-b03c-442c-9b49-b6af45e84304 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:20.779527 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5bad6c9e-b03c-442c-9b49-b6af45e84304 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:20.781824 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5bad6c9e-b03c-442c-9b49-b6af45e84304 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:20.783404 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5bad6c9e-b03c-442c-9b49-b6af45e84304 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1738 microversion: 2.20 time: 0.196116 May 26 17:00:20.784181 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 410/832] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:20 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:00:21.043139 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a5f2788d-04d4-4586-8383-8893dcea9b90 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:21.044151 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a5f2788d-04d4-4586-8383-8893dcea9b90 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:21.052402 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5f2788d-04d4-4586-8383-8893dcea9b90 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:21.054633 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5f2788d-04d4-4586-8383-8893dcea9b90 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:21.054633 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5f2788d-04d4-4586-8383-8893dcea9b90 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:21.054633 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5f2788d-04d4-4586-8383-8893dcea9b90 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:21.304456 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a5f2788d-04d4-4586-8383-8893dcea9b90 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:21.312925 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a5f2788d-04d4-4586-8383-8893dcea9b90 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1278 microversion: 2.1 time: 0.274075 May 26 17:00:21.313688 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 411/833] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:21 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1278 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:21.395600 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1d136c29-ce6e-47f9-9a03-b5b70fe9cbba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:21.396407 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1d136c29-ce6e-47f9-9a03-b5b70fe9cbba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:21.407438 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d136c29-ce6e-47f9-9a03-b5b70fe9cbba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:21.407903 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d136c29-ce6e-47f9-9a03-b5b70fe9cbba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:21.408696 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d136c29-ce6e-47f9-9a03-b5b70fe9cbba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:21.409138 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d136c29-ce6e-47f9-9a03-b5b70fe9cbba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:21.426495 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:21.630948 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1d136c29-ce6e-47f9-9a03-b5b70fe9cbba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:21.649419 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:21.652400 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1d136c29-ce6e-47f9-9a03-b5b70fe9cbba tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1367 microversion: 2.1 time: 0.260463 May 26 17:00:21.653307 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 412/834] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:21 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:21.726028 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-12648459-1171-45e0-a5bb-0207f7709128 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "POST /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.226231 May 26 17:00:21.726661 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 423/835] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 26 17:00:20 2022] POST /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments => generated 194 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:21.805882 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3b730a28-d896-4044-ba54-1aa24e831016 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:21.806754 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3b730a28-d896-4044-ba54-1aa24e831016 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:21.821294 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b730a28-d896-4044-ba54-1aa24e831016 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:21.824129 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b730a28-d896-4044-ba54-1aa24e831016 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:21.827218 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b730a28-d896-4044-ba54-1aa24e831016 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:21.827218 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3b730a28-d896-4044-ba54-1aa24e831016 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:22.139211 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3b730a28-d896-4044-ba54-1aa24e831016 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:22.153521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3b730a28-d896-4044-ba54-1aa24e831016 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:22.155753 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3b730a28-d896-4044-ba54-1aa24e831016 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:22.157536 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3b730a28-d896-4044-ba54-1aa24e831016 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1738 microversion: 2.20 time: 0.357319 May 26 17:00:22.158694 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 413/836] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:21 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1738 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:22.349698 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ae636455-50fa-43a9-95d7-f8b81dab6ea6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:22.351521 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ae636455-50fa-43a9-95d7-f8b81dab6ea6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:22.373127 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ae636455-50fa-43a9-95d7-f8b81dab6ea6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:22.374019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ae636455-50fa-43a9-95d7-f8b81dab6ea6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:22.376801 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ae636455-50fa-43a9-95d7-f8b81dab6ea6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:22.377462 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ae636455-50fa-43a9-95d7-f8b81dab6ea6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:22.625070 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ae636455-50fa-43a9-95d7-f8b81dab6ea6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:22.635190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ae636455-50fa-43a9-95d7-f8b81dab6ea6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1266 microversion: 2.1 time: 0.301444 May 26 17:00:22.636960 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 424/837] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:22 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:22.672105 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c0cb88d1-2768-4a15-b721-3c653705af09 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:22.672759 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c0cb88d1-2768-4a15-b721-3c653705af09 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:22.689289 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0cb88d1-2768-4a15-b721-3c653705af09 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:22.691004 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0cb88d1-2768-4a15-b721-3c653705af09 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:22.692748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0cb88d1-2768-4a15-b721-3c653705af09 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:22.696776 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0cb88d1-2768-4a15-b721-3c653705af09 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:22.747732 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-3eb480b7-d55c-42e7-8671-7c4f1398fee9 req-0f9163b3-f12f-4149-b7b3-19f7103ff065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ade9148-c198-4b82-af96-a501d8a82235", "tag": "eef9f36a-0b1b-49e3-a5f5-259a5554b87a"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:22.763894 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:22.782492 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=12 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:22.782492 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-3eb480b7-d55c-42e7-8671-7c4f1398fee9 req-0f9163b3-f12f-4149-b7b3-19f7103ff065 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:22.782492 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-3eb480b7-d55c-42e7-8671-7c4f1398fee9 req-0f9163b3-f12f-4149-b7b3-19f7103ff065 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:22.793202 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-3eb480b7-d55c-42e7-8671-7c4f1398fee9 req-0f9163b3-f12f-4149-b7b3-19f7103ff065 service nova] Creating event network-changed:eef9f36a-0b1b-49e3-a5f5-259a5554b87a for instance 3ade9148-c198-4b82-af96-a501d8a82235 on hv-cinder-83607 May 26 17:00:22.803048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-3eb480b7-d55c-42e7-8671-7c4f1398fee9 req-0f9163b3-f12f-4149-b7b3-19f7103ff065 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061312 May 26 17:00:22.812282 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 425/838] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:00:22.991615 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c0cb88d1-2768-4a15-b721-3c653705af09 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:23.003708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c0cb88d1-2768-4a15-b721-3c653705af09 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1367 microversion: 2.1 time: 0.338395 May 26 17:00:23.005647 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 414/839] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:22 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1367 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:23.178692 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4590cd6a-a045-43b9-b1ec-611da595e3f3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:23.179455 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4590cd6a-a045-43b9-b1ec-611da595e3f3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:23.194604 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4590cd6a-a045-43b9-b1ec-611da595e3f3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:23.195465 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4590cd6a-a045-43b9-b1ec-611da595e3f3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:23.196481 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4590cd6a-a045-43b9-b1ec-611da595e3f3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:23.197070 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4590cd6a-a045-43b9-b1ec-611da595e3f3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:23.664033 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4774637e-bc00-42bd-a97c-1d71cc01b209 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:23.664921 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4774637e-bc00-42bd-a97c-1d71cc01b209 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:23.669254 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=8 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:23.677827 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4774637e-bc00-42bd-a97c-1d71cc01b209 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:23.695149 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4774637e-bc00-42bd-a97c-1d71cc01b209 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:23.699904 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4774637e-bc00-42bd-a97c-1d71cc01b209 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:23.701439 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4774637e-bc00-42bd-a97c-1d71cc01b209 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:23.716811 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4590cd6a-a045-43b9-b1ec-611da595e3f3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:23.732586 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4590cd6a-a045-43b9-b1ec-611da595e3f3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:23.736619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4590cd6a-a045-43b9-b1ec-611da595e3f3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:23.737909 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4590cd6a-a045-43b9-b1ec-611da595e3f3 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1738 microversion: 2.20 time: 0.565063 May 26 17:00:23.740495 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 426/840] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:23 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1738 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:23.875010 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-ea7e562e-bb31-4c75-be63-3badd6116a0a req-5e572dfc-9fe7-4fac-bba1-961d61e43245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e68f0d-86ed-4e9d-8bb9-06ca9638e690", "name": "network-vif-plugged", "status": "completed", "tag": "5cdaad96-644e-4293-96b8-914e68d08378"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:23.888867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-ea7e562e-bb31-4c75-be63-3badd6116a0a req-5e572dfc-9fe7-4fac-bba1-961d61e43245 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:23.889304 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-ea7e562e-bb31-4c75-be63-3badd6116a0a req-5e572dfc-9fe7-4fac-bba1-961d61e43245 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:23.921893 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4774637e-bc00-42bd-a97c-1d71cc01b209 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:23.930515 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4774637e-bc00-42bd-a97c-1d71cc01b209 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1266 microversion: 2.1 time: 0.270727 May 26 17:00:23.931103 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 415/841] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:23 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:23.945963 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-ea7e562e-bb31-4c75-be63-3badd6116a0a req-5e572dfc-9fe7-4fac-bba1-961d61e43245 service nova] Creating event network-vif-plugged:5cdaad96-644e-4293-96b8-914e68d08378 for instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 on hv-cinder-83607 May 26 17:00:23.952903 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-ea7e562e-bb31-4c75-be63-3badd6116a0a req-5e572dfc-9fe7-4fac-bba1-961d61e43245 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080684 May 26 17:00:23.957688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 427/842] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:24.023306 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a82fa7ae-504b-46f9-a86c-8fd0c5ca3789 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:24.024328 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a82fa7ae-504b-46f9-a86c-8fd0c5ca3789 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:24.034894 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a82fa7ae-504b-46f9-a86c-8fd0c5ca3789 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:24.037772 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a82fa7ae-504b-46f9-a86c-8fd0c5ca3789 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:24.037772 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a82fa7ae-504b-46f9-a86c-8fd0c5ca3789 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:24.037772 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a82fa7ae-504b-46f9-a86c-8fd0c5ca3789 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:24.252086 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a82fa7ae-504b-46f9-a86c-8fd0c5ca3789 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:24.260692 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a82fa7ae-504b-46f9-a86c-8fd0c5ca3789 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1367 microversion: 2.1 time: 0.242622 May 26 17:00:24.261727 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 416/843] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:24 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:24.762824 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-170ebba0-121a-4adf-b4f0-1e04acf55af4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:24.770171 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-170ebba0-121a-4adf-b4f0-1e04acf55af4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:24.778431 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-170ebba0-121a-4adf-b4f0-1e04acf55af4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:24.779189 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-170ebba0-121a-4adf-b4f0-1e04acf55af4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:24.781363 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-170ebba0-121a-4adf-b4f0-1e04acf55af4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:24.783261 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-170ebba0-121a-4adf-b4f0-1e04acf55af4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:24.950123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-df4f3c56-64a9-4268-b4fe-983334569c2a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:24.952071 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-df4f3c56-64a9-4268-b4fe-983334569c2a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:24.959518 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-170ebba0-121a-4adf-b4f0-1e04acf55af4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:24.963480 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df4f3c56-64a9-4268-b4fe-983334569c2a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:24.963480 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df4f3c56-64a9-4268-b4fe-983334569c2a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:24.963480 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df4f3c56-64a9-4268-b4fe-983334569c2a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:24.963480 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-df4f3c56-64a9-4268-b4fe-983334569c2a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:24.971291 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-170ebba0-121a-4adf-b4f0-1e04acf55af4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:24.973012 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-170ebba0-121a-4adf-b4f0-1e04acf55af4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:24.974573 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-170ebba0-121a-4adf-b4f0-1e04acf55af4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1738 microversion: 2.20 time: 0.219575 May 26 17:00:24.975337 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 428/844] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:24 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:00:25.136608 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-df4f3c56-64a9-4268-b4fe-983334569c2a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:25.144801 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-df4f3c56-64a9-4268-b4fe-983334569c2a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1266 microversion: 2.1 time: 0.199761 May 26 17:00:25.145743 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 417/845] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:24 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:25.282301 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-dfd49c0f-eb89-444e-b4dd-51ffbd0ba1cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:25.282301 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-dfd49c0f-eb89-444e-b4dd-51ffbd0ba1cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:25.288491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dfd49c0f-eb89-444e-b4dd-51ffbd0ba1cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:25.289035 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dfd49c0f-eb89-444e-b4dd-51ffbd0ba1cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:25.289852 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dfd49c0f-eb89-444e-b4dd-51ffbd0ba1cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:25.290304 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dfd49c0f-eb89-444e-b4dd-51ffbd0ba1cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:25.439163 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-dfd49c0f-eb89-444e-b4dd-51ffbd0ba1cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:25.453236 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-dfd49c0f-eb89-444e-b4dd-51ffbd0ba1cb tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1367 microversion: 2.1 time: 0.177286 May 26 17:00:25.453854 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 429/846] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:25 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:25.994554 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-42a275e3-4821-42be-b09f-45e90250a44b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:25.995955 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-42a275e3-4821-42be-b09f-45e90250a44b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:26.006560 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42a275e3-4821-42be-b09f-45e90250a44b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:26.009376 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42a275e3-4821-42be-b09f-45e90250a44b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:26.009376 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42a275e3-4821-42be-b09f-45e90250a44b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:26.009376 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42a275e3-4821-42be-b09f-45e90250a44b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:26.163234 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-66d9b8f3-f56e-43ef-a714-8f77d19604ad tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:26.164783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-66d9b8f3-f56e-43ef-a714-8f77d19604ad tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:26.173107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-66d9b8f3-f56e-43ef-a714-8f77d19604ad tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:26.173691 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-66d9b8f3-f56e-43ef-a714-8f77d19604ad tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:26.175471 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-66d9b8f3-f56e-43ef-a714-8f77d19604ad tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:26.176266 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-66d9b8f3-f56e-43ef-a714-8f77d19604ad tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:26.286159 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-42a275e3-4821-42be-b09f-45e90250a44b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:26.310182 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-42a275e3-4821-42be-b09f-45e90250a44b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:26.312891 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-42a275e3-4821-42be-b09f-45e90250a44b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:26.314498 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-42a275e3-4821-42be-b09f-45e90250a44b tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1738 microversion: 2.20 time: 0.324554 May 26 17:00:26.315096 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 418/847] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:25 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1738 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:26.416483 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-66d9b8f3-f56e-43ef-a714-8f77d19604ad tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:26.426447 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-66d9b8f3-f56e-43ef-a714-8f77d19604ad tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1266 microversion: 2.1 time: 0.268131 May 26 17:00:26.431425 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 430/848] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:26 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:26.471662 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d2d3e6ee-f2b5-4d77-90bb-da07f5017e8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:26.472282 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d2d3e6ee-f2b5-4d77-90bb-da07f5017e8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:26.479739 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2d3e6ee-f2b5-4d77-90bb-da07f5017e8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:26.480470 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2d3e6ee-f2b5-4d77-90bb-da07f5017e8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:26.481465 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2d3e6ee-f2b5-4d77-90bb-da07f5017e8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:26.481903 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2d3e6ee-f2b5-4d77-90bb-da07f5017e8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:26.667437 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d2d3e6ee-f2b5-4d77-90bb-da07f5017e8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:26.688233 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d2d3e6ee-f2b5-4d77-90bb-da07f5017e8f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1558 microversion: 2.1 time: 0.221085 May 26 17:00:26.688993 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 419/849] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:26 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:26.709490 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e839a279-c91a-4152-a4b1-5e4ebd32121e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:26.710836 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e839a279-c91a-4152-a4b1-5e4ebd32121e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:26.726542 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e839a279-c91a-4152-a4b1-5e4ebd32121e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:26.726959 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e839a279-c91a-4152-a4b1-5e4ebd32121e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:26.727871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e839a279-c91a-4152-a4b1-5e4ebd32121e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:26.728565 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e839a279-c91a-4152-a4b1-5e4ebd32121e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:26.837609 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e839a279-c91a-4152-a4b1-5e4ebd32121e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135088 May 26 17:00:26.839007 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 431/850] 10.222.0.48 () {58 vars in 1274 bytes} [Thu May 26 17:00:26 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:00:27.336596 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ec9cf4cb-4891-4426-bab1-e68faa5923e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:27.337197 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ec9cf4cb-4891-4426-bab1-e68faa5923e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:27.347845 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ec9cf4cb-4891-4426-bab1-e68faa5923e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:27.348299 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ec9cf4cb-4891-4426-bab1-e68faa5923e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:27.353918 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ec9cf4cb-4891-4426-bab1-e68faa5923e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:27.354376 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ec9cf4cb-4891-4426-bab1-e68faa5923e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:27.448451 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c51c1a30-88ce-4fdd-9db7-86a31eb92ecc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:27.449690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c51c1a30-88ce-4fdd-9db7-86a31eb92ecc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:27.461529 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c51c1a30-88ce-4fdd-9db7-86a31eb92ecc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:27.469120 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c51c1a30-88ce-4fdd-9db7-86a31eb92ecc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:27.478310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c51c1a30-88ce-4fdd-9db7-86a31eb92ecc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:27.478781 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c51c1a30-88ce-4fdd-9db7-86a31eb92ecc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:27.595187 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ec9cf4cb-4891-4426-bab1-e68faa5923e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:27.612914 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ec9cf4cb-4891-4426-bab1-e68faa5923e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:27.628526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ec9cf4cb-4891-4426-bab1-e68faa5923e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:27.628526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ec9cf4cb-4891-4426-bab1-e68faa5923e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1738 microversion: 2.20 time: 0.286759 May 26 17:00:27.629764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 420/851] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:27 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:27.721372 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c51c1a30-88ce-4fdd-9db7-86a31eb92ecc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:27.734661 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c51c1a30-88ce-4fdd-9db7-86a31eb92ecc tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1266 microversion: 2.1 time: 0.288589 May 26 17:00:27.743425 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 432/852] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:27 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:28.642866 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-787ee8f9-b4fe-4b99-ba1f-d24d68f1a812 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:28.643654 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-787ee8f9-b4fe-4b99-ba1f-d24d68f1a812 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:28.660732 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-787ee8f9-b4fe-4b99-ba1f-d24d68f1a812 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:28.661203 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-787ee8f9-b4fe-4b99-ba1f-d24d68f1a812 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:28.662025 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-787ee8f9-b4fe-4b99-ba1f-d24d68f1a812 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:28.662473 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-787ee8f9-b4fe-4b99-ba1f-d24d68f1a812 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:28.698502 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-124845cb-f32a-4323-95c0-4f10ea64e725 req-35e4cdae-5718-4f6a-8400-c0df347f173b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e68f0d-86ed-4e9d-8bb9-06ca9638e690", "tag": "5cdaad96-644e-4293-96b8-914e68d08378"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:28.716425 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-124845cb-f32a-4323-95c0-4f10ea64e725 req-35e4cdae-5718-4f6a-8400-c0df347f173b service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:28.717127 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-124845cb-f32a-4323-95c0-4f10ea64e725 req-35e4cdae-5718-4f6a-8400-c0df347f173b service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:28.730333 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-124845cb-f32a-4323-95c0-4f10ea64e725 req-35e4cdae-5718-4f6a-8400-c0df347f173b service nova] Creating event network-changed:5cdaad96-644e-4293-96b8-914e68d08378 for instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 on hv-cinder-83607 May 26 17:00:28.736392 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-124845cb-f32a-4323-95c0-4f10ea64e725 req-35e4cdae-5718-4f6a-8400-c0df347f173b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042745 May 26 17:00:28.737506 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 433/853] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:00:28.750595 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2e4548df-4871-4478-ba16-bd27db69a83b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:28.751776 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2e4548df-4871-4478-ba16-bd27db69a83b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:28.758523 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2e4548df-4871-4478-ba16-bd27db69a83b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:28.759443 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2e4548df-4871-4478-ba16-bd27db69a83b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:28.761043 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2e4548df-4871-4478-ba16-bd27db69a83b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:28.761043 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2e4548df-4871-4478-ba16-bd27db69a83b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:28.899224 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-787ee8f9-b4fe-4b99-ba1f-d24d68f1a812 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:28.908482 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-787ee8f9-b4fe-4b99-ba1f-d24d68f1a812 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:28.910827 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-787ee8f9-b4fe-4b99-ba1f-d24d68f1a812 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:28.912783 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-787ee8f9-b4fe-4b99-ba1f-d24d68f1a812 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1738 microversion: 2.20 time: 0.274541 May 26 17:00:28.913419 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 421/854] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:28 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1738 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:28.949522 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2e4548df-4871-4478-ba16-bd27db69a83b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:28.960970 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2e4548df-4871-4478-ba16-bd27db69a83b tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1266 microversion: 2.1 time: 0.215053 May 26 17:00:28.962027 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 434/855] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:28 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:29.950970 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a3a8349d-0b41-4aa8-9ec9-d66a73fea056 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:29.952235 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a3a8349d-0b41-4aa8-9ec9-d66a73fea056 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:29.965082 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3a8349d-0b41-4aa8-9ec9-d66a73fea056 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:29.965883 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3a8349d-0b41-4aa8-9ec9-d66a73fea056 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:29.967020 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3a8349d-0b41-4aa8-9ec9-d66a73fea056 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:29.974681 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a3a8349d-0b41-4aa8-9ec9-d66a73fea056 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:29.982692 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7df98fdf-35a7-440e-b701-3fd2ffbf4c73 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:29.984472 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7df98fdf-35a7-440e-b701-3fd2ffbf4c73 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:30.000328 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7df98fdf-35a7-440e-b701-3fd2ffbf4c73 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:30.001142 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7df98fdf-35a7-440e-b701-3fd2ffbf4c73 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:30.002177 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7df98fdf-35a7-440e-b701-3fd2ffbf4c73 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:30.004635 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7df98fdf-35a7-440e-b701-3fd2ffbf4c73 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:30.273547 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a3a8349d-0b41-4aa8-9ec9-d66a73fea056 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:30.283138 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a3a8349d-0b41-4aa8-9ec9-d66a73fea056 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:30.289310 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a3a8349d-0b41-4aa8-9ec9-d66a73fea056 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:30.294647 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a3a8349d-0b41-4aa8-9ec9-d66a73fea056 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1738 microversion: 2.20 time: 0.345707 May 26 17:00:30.295076 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7df98fdf-35a7-440e-b701-3fd2ffbf4c73 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:30.300249 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 422/856] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:29 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1738 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:30.318537 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7df98fdf-35a7-440e-b701-3fd2ffbf4c73 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1266 microversion: 2.1 time: 0.342700 May 26 17:00:30.328974 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 435/857] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:29 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1266 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:31.317050 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-367c6707-f4de-412a-9382-4a0594c1ef61 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:31.317703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-367c6707-f4de-412a-9382-4a0594c1ef61 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:31.326778 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-367c6707-f4de-412a-9382-4a0594c1ef61 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:31.328058 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-367c6707-f4de-412a-9382-4a0594c1ef61 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:31.328849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-367c6707-f4de-412a-9382-4a0594c1ef61 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:31.329339 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-367c6707-f4de-412a-9382-4a0594c1ef61 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:31.335783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-44797ff1-6c89-45d3-a8f2-2055590fe1e5 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:31.337328 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-44797ff1-6c89-45d3-a8f2-2055590fe1e5 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:31.345424 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-44797ff1-6c89-45d3-a8f2-2055590fe1e5 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:31.346172 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-44797ff1-6c89-45d3-a8f2-2055590fe1e5 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:31.347144 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-44797ff1-6c89-45d3-a8f2-2055590fe1e5 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:31.347589 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-44797ff1-6c89-45d3-a8f2-2055590fe1e5 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:31.560579 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-367c6707-f4de-412a-9382-4a0594c1ef61 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:31.573369 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-367c6707-f4de-412a-9382-4a0594c1ef61 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:31.574994 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-367c6707-f4de-412a-9382-4a0594c1ef61 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:31.576396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-367c6707-f4de-412a-9382-4a0594c1ef61 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1738 microversion: 2.20 time: 0.265887 May 26 17:00:31.584259 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-44797ff1-6c89-45d3-a8f2-2055590fe1e5 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:31.595597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-44797ff1-6c89-45d3-a8f2-2055590fe1e5 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1266 microversion: 2.1 time: 0.263580 May 26 17:00:31.595876 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 423/858] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:31 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1738 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:31.596863 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 436/859] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:31 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:31.731625 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-164a5207-60fe-4a38-8462-a3cd399d2271 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:31.736468 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-164a5207-60fe-4a38-8462-a3cd399d2271 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:31.744981 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-164a5207-60fe-4a38-8462-a3cd399d2271 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:31.745609 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-164a5207-60fe-4a38-8462-a3cd399d2271 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:31.747242 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-164a5207-60fe-4a38-8462-a3cd399d2271 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:31.747770 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-164a5207-60fe-4a38-8462-a3cd399d2271 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:31.805053 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-164a5207-60fe-4a38-8462-a3cd399d2271 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078526 May 26 17:00:31.806298 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 424/860] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 17:00:31 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:31.816086 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-68d8e411-1bd7-413c-9614-4f9d548013e4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:31.816595 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-68d8e411-1bd7-413c-9614-4f9d548013e4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:31.823363 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-68d8e411-1bd7-413c-9614-4f9d548013e4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:31.824187 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-68d8e411-1bd7-413c-9614-4f9d548013e4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:31.825307 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-68d8e411-1bd7-413c-9614-4f9d548013e4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:31.825751 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-68d8e411-1bd7-413c-9614-4f9d548013e4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:31.868814 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-68d8e411-1bd7-413c-9614-4f9d548013e4 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments/a442e33c-4ba9-45dc-ae01-56025f4187e7" status: 200 len: 194 microversion: 2.1 time: 0.050434 May 26 17:00:31.868814 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 437/861] 10.222.0.48 () {58 vars in 1412 bytes} [Thu May 26 17:00:31 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments/a442e33c-4ba9-45dc-ae01-56025f4187e7 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:32.601753 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6818755a-7fe3-4599-9e71-c3e9acc19033 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:32.601753 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6818755a-7fe3-4599-9e71-c3e9acc19033 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:32.604988 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6818755a-7fe3-4599-9e71-c3e9acc19033 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:32.605784 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6818755a-7fe3-4599-9e71-c3e9acc19033 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:32.606690 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6818755a-7fe3-4599-9e71-c3e9acc19033 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:32.607202 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6818755a-7fe3-4599-9e71-c3e9acc19033 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:32.617886 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ea13bf70-f248-4b8a-9d4b-6b83127ee3b7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:32.619474 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ea13bf70-f248-4b8a-9d4b-6b83127ee3b7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:32.629360 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ea13bf70-f248-4b8a-9d4b-6b83127ee3b7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:32.630162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ea13bf70-f248-4b8a-9d4b-6b83127ee3b7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:32.631159 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ea13bf70-f248-4b8a-9d4b-6b83127ee3b7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:32.632719 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ea13bf70-f248-4b8a-9d4b-6b83127ee3b7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:32.831724 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ea13bf70-f248-4b8a-9d4b-6b83127ee3b7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:32.834732 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6818755a-7fe3-4599-9e71-c3e9acc19033 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:32.840262 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ea13bf70-f248-4b8a-9d4b-6b83127ee3b7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1266 microversion: 2.1 time: 0.229983 May 26 17:00:32.843781 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6818755a-7fe3-4599-9e71-c3e9acc19033 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:32.863386 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 438/862] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:32 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:32.863601 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6818755a-7fe3-4599-9e71-c3e9acc19033 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:32.863601 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6818755a-7fe3-4599-9e71-c3e9acc19033 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1738 microversion: 2.20 time: 0.255588 May 26 17:00:32.863601 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 425/863] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:32 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:32.863916 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-976491113", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "networks": [{"uuid": "12a87d45-8370-4248-b552-63dea63c9b5d"}]}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:32.911250 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.network.neutron [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] validate_networks() for [('12a87d45-8370-4248-b552-63dea63c9b5d', None, None, None, None, None)] {{(pid=124836) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:00:33.307279 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Flavor limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:00:33.307604 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Image limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:00:33.308085 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Flavor pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:00:33.308502 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Image pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:00:33.308923 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:00:33.321156 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:33.321763 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:33.322678 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:33.323219 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:33.342570 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Getting quotas for project c6ad6af479db4e92933ac0d1567f25e1. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:00:33.346913 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Getting quotas for user 284df7837ac84a98992207ac01587020 and project c6ad6af479db4e92933ac0d1567f25e1. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:00:33.359434 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Going to run 1 instances... {{(pid=124836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:00:33.361835 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:00:33.508485 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-94d0142e-c940-450b-9dd6-b291e123b3bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661692 May 26 17:00:33.514181 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 439/864] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 17:00:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 17:00:33.522018 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-60058d8d-5f0c-4a50-9229-19e3b528d874 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:33.522847 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-60058d8d-5f0c-4a50-9229-19e3b528d874 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:33.612011 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-60058d8d-5f0c-4a50-9229-19e3b528d874 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:33.617880 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-97883969-968a-4a72-a923-1d8c5900fc70 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5db00150-15b6-4c52-989a-e77101eef4bf"}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:33.619214 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-97883969-968a-4a72-a923-1d8c5900fc70 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:33.620069 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-60058d8d-5f0c-4a50-9229-19e3b528d874 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1218 microversion: 2.1 time: 0.103835 May 26 17:00:33.621404 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 426/865] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:33 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:33.631352 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-97883969-968a-4a72-a923-1d8c5900fc70 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:33.631914 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-97883969-968a-4a72-a923-1d8c5900fc70 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:33.632820 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-97883969-968a-4a72-a923-1d8c5900fc70 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:33.633364 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-97883969-968a-4a72-a923-1d8c5900fc70 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:33.820386 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-72c262e3-ece4-4429-94b6-22c6f690ae84 req-8e7b02dd-64ed-4c40-906d-ae2f678ae3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ade9148-c198-4b82-af96-a501d8a82235", "name": "network-vif-plugged", "status": "completed", "tag": "eef9f36a-0b1b-49e3-a5f5-259a5554b87a"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:33.830772 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-72c262e3-ece4-4429-94b6-22c6f690ae84 req-8e7b02dd-64ed-4c40-906d-ae2f678ae3c4 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:33.831353 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-72c262e3-ece4-4429-94b6-22c6f690ae84 req-8e7b02dd-64ed-4c40-906d-ae2f678ae3c4 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:33.849501 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-72c262e3-ece4-4429-94b6-22c6f690ae84 req-8e7b02dd-64ed-4c40-906d-ae2f678ae3c4 service nova] Creating event network-vif-plugged:eef9f36a-0b1b-49e3-a5f5-259a5554b87a for instance 3ade9148-c198-4b82-af96-a501d8a82235 on hv-cinder-83607 May 26 17:00:33.849501 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-72c262e3-ece4-4429-94b6-22c6f690ae84 req-8e7b02dd-64ed-4c40-906d-ae2f678ae3c4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033184 May 26 17:00:33.850881 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 427/866] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:00:33.862572 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-51f907e5-71a8-43e7-8462-fffb33df0646 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:33.863280 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-51f907e5-71a8-43e7-8462-fffb33df0646 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:33.869877 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-51f907e5-71a8-43e7-8462-fffb33df0646 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:33.870320 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-51f907e5-71a8-43e7-8462-fffb33df0646 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:33.871089 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-51f907e5-71a8-43e7-8462-fffb33df0646 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:33.871592 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-51f907e5-71a8-43e7-8462-fffb33df0646 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:34.019073 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-51f907e5-71a8-43e7-8462-fffb33df0646 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:34.028486 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-51f907e5-71a8-43e7-8462-fffb33df0646 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1266 microversion: 2.1 time: 0.171576 May 26 17:00:34.029066 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 428/867] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:33 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:34.034685 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a96e738a-7a1e-4fdc-aa22-1a422504cbf6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:34.037780 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a96e738a-7a1e-4fdc-aa22-1a422504cbf6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:34.041587 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a96e738a-7a1e-4fdc-aa22-1a422504cbf6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:34.042041 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a96e738a-7a1e-4fdc-aa22-1a422504cbf6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:34.042830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a96e738a-7a1e-4fdc-aa22-1a422504cbf6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:34.043285 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a96e738a-7a1e-4fdc-aa22-1a422504cbf6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:34.198160 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a96e738a-7a1e-4fdc-aa22-1a422504cbf6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:34.207439 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a96e738a-7a1e-4fdc-aa22-1a422504cbf6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:34.216434 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a96e738a-7a1e-4fdc-aa22-1a422504cbf6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:34.216434 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a96e738a-7a1e-4fdc-aa22-1a422504cbf6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1738 microversion: 2.20 time: 0.179795 May 26 17:00:34.216434 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 429/868] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:34 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:34.607212 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-97883969-968a-4a72-a923-1d8c5900fc70 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "POST /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.994651 May 26 17:00:34.607831 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 440/869] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 26 17:00:33 2022] POST /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments => generated 194 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:00:34.639002 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f81934ef-cb39-4af8-891e-4cc960ee3640 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:34.639749 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f81934ef-cb39-4af8-891e-4cc960ee3640 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:34.700339 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f81934ef-cb39-4af8-891e-4cc960ee3640 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:34.707755 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f81934ef-cb39-4af8-891e-4cc960ee3640 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1218 microversion: 2.1 time: 0.073351 May 26 17:00:34.708334 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 430/870] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:34 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:35.047833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5374eb53-da38-40ba-83cf-b37e5709267c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:35.048531 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5374eb53-da38-40ba-83cf-b37e5709267c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:35.054853 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5374eb53-da38-40ba-83cf-b37e5709267c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:35.065419 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5374eb53-da38-40ba-83cf-b37e5709267c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:35.065419 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5374eb53-da38-40ba-83cf-b37e5709267c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:35.065419 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5374eb53-da38-40ba-83cf-b37e5709267c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:35.194263 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5374eb53-da38-40ba-83cf-b37e5709267c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:35.201800 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5374eb53-da38-40ba-83cf-b37e5709267c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1266 microversion: 2.1 time: 0.159339 May 26 17:00:35.203051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 441/871] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:35 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:35.229191 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-38592a2c-7992-44fa-8063-0cd7acea4b43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:35.229853 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-38592a2c-7992-44fa-8063-0cd7acea4b43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:35.236344 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38592a2c-7992-44fa-8063-0cd7acea4b43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:35.237956 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38592a2c-7992-44fa-8063-0cd7acea4b43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:35.238767 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38592a2c-7992-44fa-8063-0cd7acea4b43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:35.239242 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-38592a2c-7992-44fa-8063-0cd7acea4b43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:35.259146 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:35.372146 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-38592a2c-7992-44fa-8063-0cd7acea4b43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:35.384148 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-38592a2c-7992-44fa-8063-0cd7acea4b43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:35.385736 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-38592a2c-7992-44fa-8063-0cd7acea4b43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:35.386929 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-38592a2c-7992-44fa-8063-0cd7acea4b43 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1720 microversion: 2.20 time: 0.162483 May 26 17:00:35.398462 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 431/872] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:35 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:35.725096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a8820029-7055-4b7c-befd-12b556d63fe7 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:35.725759 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a8820029-7055-4b7c-befd-12b556d63fe7 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:35.732672 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a8820029-7055-4b7c-befd-12b556d63fe7 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:35.733156 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a8820029-7055-4b7c-befd-12b556d63fe7 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:35.734580 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a8820029-7055-4b7c-befd-12b556d63fe7 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:35.735017 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a8820029-7055-4b7c-befd-12b556d63fe7 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:35.739454 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:35.800184 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a8820029-7055-4b7c-befd-12b556d63fe7 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:35.807860 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a8820029-7055-4b7c-befd-12b556d63fe7 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1214 microversion: 2.1 time: 0.087142 May 26 17:00:35.808419 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 442/873] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:35 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:36.219710 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9ad9dbb6-3af5-46ab-afb3-d9fa77ee8dbd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:36.220332 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9ad9dbb6-3af5-46ab-afb3-d9fa77ee8dbd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:36.227827 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ad9dbb6-3af5-46ab-afb3-d9fa77ee8dbd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:36.228331 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ad9dbb6-3af5-46ab-afb3-d9fa77ee8dbd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:36.229106 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ad9dbb6-3af5-46ab-afb3-d9fa77ee8dbd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:36.229574 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ad9dbb6-3af5-46ab-afb3-d9fa77ee8dbd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:36.377147 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9ad9dbb6-3af5-46ab-afb3-d9fa77ee8dbd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:36.385031 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9ad9dbb6-3af5-46ab-afb3-d9fa77ee8dbd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1266 microversion: 2.1 time: 0.169254 May 26 17:00:36.385636 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 432/874] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:36 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:36.406136 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-954943cc-e735-4069-b155-0b9ff4a73d4d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:36.408126 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-954943cc-e735-4069-b155-0b9ff4a73d4d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:36.413835 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-954943cc-e735-4069-b155-0b9ff4a73d4d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:36.414284 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-954943cc-e735-4069-b155-0b9ff4a73d4d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:36.415039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-954943cc-e735-4069-b155-0b9ff4a73d4d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:36.415482 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-954943cc-e735-4069-b155-0b9ff4a73d4d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:36.548037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-954943cc-e735-4069-b155-0b9ff4a73d4d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:36.556594 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-954943cc-e735-4069-b155-0b9ff4a73d4d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:36.558123 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-954943cc-e735-4069-b155-0b9ff4a73d4d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:36.559307 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-954943cc-e735-4069-b155-0b9ff4a73d4d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1720 microversion: 2.20 time: 0.157140 May 26 17:00:36.559889 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 443/875] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:36 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:36.830122 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f94886fb-d2ee-4a80-8f8a-c6d7a60e47b2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:36.830737 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f94886fb-d2ee-4a80-8f8a-c6d7a60e47b2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:36.836978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f94886fb-d2ee-4a80-8f8a-c6d7a60e47b2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:36.837471 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f94886fb-d2ee-4a80-8f8a-c6d7a60e47b2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:36.838343 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f94886fb-d2ee-4a80-8f8a-c6d7a60e47b2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:36.838778 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f94886fb-d2ee-4a80-8f8a-c6d7a60e47b2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:36.906885 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f94886fb-d2ee-4a80-8f8a-c6d7a60e47b2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:36.914384 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f94886fb-d2ee-4a80-8f8a-c6d7a60e47b2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1270 microversion: 2.1 time: 0.088418 May 26 17:00:36.914945 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 433/876] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:36 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:37.402279 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c4020a94-4d37-4524-8606-ebafd23c69d3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:37.402801 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c4020a94-4d37-4524-8606-ebafd23c69d3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:37.409771 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c4020a94-4d37-4524-8606-ebafd23c69d3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:37.410455 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c4020a94-4d37-4524-8606-ebafd23c69d3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:37.410991 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c4020a94-4d37-4524-8606-ebafd23c69d3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:37.411428 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c4020a94-4d37-4524-8606-ebafd23c69d3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:37.548653 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c4020a94-4d37-4524-8606-ebafd23c69d3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:37.556562 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c4020a94-4d37-4524-8606-ebafd23c69d3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1452 microversion: 2.1 time: 0.158239 May 26 17:00:37.557156 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 444/877] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:37 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:37.573100 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a128f834-9f29-428c-a850-c4d453802ca6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:37.574395 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a128f834-9f29-428c-a850-c4d453802ca6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:37.578262 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1a294750-c474-4e2a-a9c5-35fac6e8a820 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:37.578914 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1a294750-c474-4e2a-a9c5-35fac6e8a820 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:37.582115 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a128f834-9f29-428c-a850-c4d453802ca6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:37.582574 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a128f834-9f29-428c-a850-c4d453802ca6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:37.583376 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a128f834-9f29-428c-a850-c4d453802ca6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:37.583819 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a128f834-9f29-428c-a850-c4d453802ca6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:37.585415 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1a294750-c474-4e2a-a9c5-35fac6e8a820 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:37.585878 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1a294750-c474-4e2a-a9c5-35fac6e8a820 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:37.586666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1a294750-c474-4e2a-a9c5-35fac6e8a820 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:37.587132 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1a294750-c474-4e2a-a9c5-35fac6e8a820 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:37.792884 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a128f834-9f29-428c-a850-c4d453802ca6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:37.798764 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1a294750-c474-4e2a-a9c5-35fac6e8a820 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:37.800817 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a128f834-9f29-428c-a850-c4d453802ca6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1452 microversion: 2.1 time: 0.231662 May 26 17:00:37.801423 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 434/878] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:37 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1452 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:37.806163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-04dab1cc-e70c-4bea-9c77-673cdeeb4d71 req-0bbf5cb7-48b4-41e0-89ed-6de7dc91c459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ca388b-87f7-46b3-81f0-5e7d06e9dcc1", "name": "network-vif-unplugged", "status": "completed", "tag": "17153ebf-8de6-4b1d-bafd-f2c2e8580998"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:37.825677 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-04dab1cc-e70c-4bea-9c77-673cdeeb4d71 req-0bbf5cb7-48b4-41e0-89ed-6de7dc91c459 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:37.825677 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-04dab1cc-e70c-4bea-9c77-673cdeeb4d71 req-0bbf5cb7-48b4-41e0-89ed-6de7dc91c459 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:37.825910 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1a294750-c474-4e2a-a9c5-35fac6e8a820 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:37.825910 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1a294750-c474-4e2a-a9c5-35fac6e8a820 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:37.825910 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-1a294750-c474-4e2a-a9c5-35fac6e8a820 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1720 microversion: 2.20 time: 0.245716 May 26 17:00:37.826187 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 445/879] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:37 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1720 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:37.832881 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-04dab1cc-e70c-4bea-9c77-673cdeeb4d71 req-0bbf5cb7-48b4-41e0-89ed-6de7dc91c459 service nova] Creating event network-vif-unplugged:17153ebf-8de6-4b1d-bafd-f2c2e8580998 for instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 on hv-cinder-83607 May 26 17:00:37.839048 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-04dab1cc-e70c-4bea-9c77-673cdeeb4d71 req-0bbf5cb7-48b4-41e0-89ed-6de7dc91c459 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036228 May 26 17:00:37.840212 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 435/880] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:37.932493 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-63719658-8316-42f3-acaa-ccd12c1d51e2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:37.933132 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-63719658-8316-42f3-acaa-ccd12c1d51e2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:37.939360 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-63719658-8316-42f3-acaa-ccd12c1d51e2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:37.941899 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-63719658-8316-42f3-acaa-ccd12c1d51e2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:37.941899 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-63719658-8316-42f3-acaa-ccd12c1d51e2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:37.941899 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-63719658-8316-42f3-acaa-ccd12c1d51e2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:38.002548 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-63719658-8316-42f3-acaa-ccd12c1d51e2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:38.010207 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-63719658-8316-42f3-acaa-ccd12c1d51e2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1278 microversion: 2.1 time: 0.081649 May 26 17:00:38.010727 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 446/881] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:37 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1278 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:38.843899 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d2f5f443-0c27-4b4f-bc8c-9822297499f7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:38.845843 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d2f5f443-0c27-4b4f-bc8c-9822297499f7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:38.854774 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2f5f443-0c27-4b4f-bc8c-9822297499f7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:38.855309 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2f5f443-0c27-4b4f-bc8c-9822297499f7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:38.856738 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2f5f443-0c27-4b4f-bc8c-9822297499f7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:38.857033 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2f5f443-0c27-4b4f-bc8c-9822297499f7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:39.024360 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d2f5f443-0c27-4b4f-bc8c-9822297499f7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:39.028920 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c6335c16-17b3-41d5-a584-d1f1201495b6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:39.029577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c6335c16-17b3-41d5-a584-d1f1201495b6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:39.040817 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d2f5f443-0c27-4b4f-bc8c-9822297499f7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:39.041036 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c6335c16-17b3-41d5-a584-d1f1201495b6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:39.041151 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d2f5f443-0c27-4b4f-bc8c-9822297499f7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:39.041302 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c6335c16-17b3-41d5-a584-d1f1201495b6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:39.041302 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c6335c16-17b3-41d5-a584-d1f1201495b6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:39.041476 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d2f5f443-0c27-4b4f-bc8c-9822297499f7 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1723 microversion: 2.20 time: 0.199880 May 26 17:00:39.041555 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c6335c16-17b3-41d5-a584-d1f1201495b6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:39.041633 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 436/882] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:38 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:39.058857 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-abe60e9b-b973-4cbe-b095-fcf1c0397e64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6330d823-d4ab-43ca-8914-cea05d6626f7"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:39.059945 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-abe60e9b-b973-4cbe-b095-fcf1c0397e64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:39.070978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-abe60e9b-b973-4cbe-b095-fcf1c0397e64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:39.071879 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-abe60e9b-b973-4cbe-b095-fcf1c0397e64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:39.074642 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-abe60e9b-b973-4cbe-b095-fcf1c0397e64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:39.075257 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-abe60e9b-b973-4cbe-b095-fcf1c0397e64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:39.117154 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c6335c16-17b3-41d5-a584-d1f1201495b6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:39.128367 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c6335c16-17b3-41d5-a584-d1f1201495b6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1276 microversion: 2.1 time: 0.103430 May 26 17:00:39.129628 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 447/883] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:39 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1276 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:39.989512 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-abe60e9b-b973-4cbe-b095-fcf1c0397e64 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "POST /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.934877 May 26 17:00:39.990473 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 437/884] 10.222.0.48 () {62 vars in 1363 bytes} [Thu May 26 17:00:39 2022] POST /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1/os-volume_attachments => generated 188 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 17:00:40.123438 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9436f2b2-ad00-4f2c-a071-d0b30e08dd29 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:40.124076 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9436f2b2-ad00-4f2c-a071-d0b30e08dd29 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:40.131238 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9436f2b2-ad00-4f2c-a071-d0b30e08dd29 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:40.131850 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9436f2b2-ad00-4f2c-a071-d0b30e08dd29 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:40.132713 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9436f2b2-ad00-4f2c-a071-d0b30e08dd29 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:40.133229 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9436f2b2-ad00-4f2c-a071-d0b30e08dd29 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:40.147078 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-97f1261e-4a84-4770-a42d-09db615eef8a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:40.147787 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-97f1261e-4a84-4770-a42d-09db615eef8a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:40.154844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-97f1261e-4a84-4770-a42d-09db615eef8a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:40.156078 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-97f1261e-4a84-4770-a42d-09db615eef8a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:40.157237 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-97f1261e-4a84-4770-a42d-09db615eef8a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:40.157770 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-97f1261e-4a84-4770-a42d-09db615eef8a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:40.304379 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-97f1261e-4a84-4770-a42d-09db615eef8a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:40.313684 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-97f1261e-4a84-4770-a42d-09db615eef8a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.170351 May 26 17:00:40.314316 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 438/885] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:40 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:40.878445 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-7e113e43-d7f1-467f-8b1d-f14ac47ea107 req-65d35e46-6100-4482-a0f8-a4745d2c2ccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ade9148-c198-4b82-af96-a501d8a82235", "tag": "eef9f36a-0b1b-49e3-a5f5-259a5554b87a"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:40.887016 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-7e113e43-d7f1-467f-8b1d-f14ac47ea107 req-65d35e46-6100-4482-a0f8-a4745d2c2ccf service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:40.887461 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-7e113e43-d7f1-467f-8b1d-f14ac47ea107 req-65d35e46-6100-4482-a0f8-a4745d2c2ccf service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:40.899213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-7e113e43-d7f1-467f-8b1d-f14ac47ea107 req-65d35e46-6100-4482-a0f8-a4745d2c2ccf service nova] Creating event network-changed:eef9f36a-0b1b-49e3-a5f5-259a5554b87a for instance 3ade9148-c198-4b82-af96-a501d8a82235 on hv-cinder-83607 May 26 17:00:40.904371 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-7e113e43-d7f1-467f-8b1d-f14ac47ea107 req-65d35e46-6100-4482-a0f8-a4745d2c2ccf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029652 May 26 17:00:40.904987 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 439/886] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:41.006707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9436f2b2-ad00-4f2c-a071-d0b30e08dd29 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "DELETE /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1/os-volume_attachments/6330d823-d4ab-43ca-8914-cea05d6626f7" status: 202 len: 0 microversion: 2.20 time: 0.887400 May 26 17:00:41.008299 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 448/887] 10.222.0.48 () {60 vars in 1456 bytes} [Thu May 26 17:00:40 2022] DELETE /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1/os-volume_attachments/6330d823-d4ab-43ca-8914-cea05d6626f7 => generated 0 bytes in 890 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 17:00:41.082989 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3dbe8fce-55ee-44a8-b6dc-a2a7e7a75918 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:41.083686 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3dbe8fce-55ee-44a8-b6dc-a2a7e7a75918 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:41.090873 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3dbe8fce-55ee-44a8-b6dc-a2a7e7a75918 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:41.091672 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3dbe8fce-55ee-44a8-b6dc-a2a7e7a75918 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:41.095606 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3dbe8fce-55ee-44a8-b6dc-a2a7e7a75918 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:41.095606 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3dbe8fce-55ee-44a8-b6dc-a2a7e7a75918 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:41.306561 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3dbe8fce-55ee-44a8-b6dc-a2a7e7a75918 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "POST /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1/action" status: 202 len: 0 microversion: 2.20 time: 0.229664 May 26 17:00:41.311024 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 440/888] 10.222.0.48 () {62 vars in 1318 bytes} [Thu May 26 17:00:41 2022] POST /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 17:00:41.319594 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-53f3b8f5-79dc-4c73-9907-66e2e0c7928d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:41.320289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-53f3b8f5-79dc-4c73-9907-66e2e0c7928d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:41.330153 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-53f3b8f5-79dc-4c73-9907-66e2e0c7928d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:41.331078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-53f3b8f5-79dc-4c73-9907-66e2e0c7928d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:41.332554 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3f3e333d-b8b8-45e8-b6e8-280c6d77c575 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:41.333501 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3f3e333d-b8b8-45e8-b6e8-280c6d77c575 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:41.333819 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-53f3b8f5-79dc-4c73-9907-66e2e0c7928d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:41.334518 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-53f3b8f5-79dc-4c73-9907-66e2e0c7928d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:41.345116 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3f3e333d-b8b8-45e8-b6e8-280c6d77c575 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:41.345751 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3f3e333d-b8b8-45e8-b6e8-280c6d77c575 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:41.348726 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3f3e333d-b8b8-45e8-b6e8-280c6d77c575 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:41.349587 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3f3e333d-b8b8-45e8-b6e8-280c6d77c575 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:41.565341 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-53f3b8f5-79dc-4c73-9907-66e2e0c7928d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:41.574188 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-53f3b8f5-79dc-4c73-9907-66e2e0c7928d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:41.581859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3f3e333d-b8b8-45e8-b6e8-280c6d77c575 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:41.587372 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-53f3b8f5-79dc-4c73-9907-66e2e0c7928d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:41.592032 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3f3e333d-b8b8-45e8-b6e8-280c6d77c575 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.264675 May 26 17:00:41.592672 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 441/889] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:41 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:41.595237 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-53f3b8f5-79dc-4c73-9907-66e2e0c7928d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1671 microversion: 2.20 time: 0.282524 May 26 17:00:41.606417 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 449/890] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:41 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1671 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:42.610095 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c4d0e834-9286-43c0-995e-606d9f017cba tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:42.611065 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c4d0e834-9286-43c0-995e-606d9f017cba tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:42.615039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1a509702-8c4b-44c2-bbf4-03cc0450d87d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:42.616164 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1a509702-8c4b-44c2-bbf4-03cc0450d87d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:42.617755 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c4d0e834-9286-43c0-995e-606d9f017cba tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:42.618220 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c4d0e834-9286-43c0-995e-606d9f017cba tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:42.619001 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c4d0e834-9286-43c0-995e-606d9f017cba tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:42.619440 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c4d0e834-9286-43c0-995e-606d9f017cba tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:42.625058 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1a509702-8c4b-44c2-bbf4-03cc0450d87d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:42.625831 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1a509702-8c4b-44c2-bbf4-03cc0450d87d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:42.627167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1a509702-8c4b-44c2-bbf4-03cc0450d87d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:42.627680 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1a509702-8c4b-44c2-bbf4-03cc0450d87d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:42.839142 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1a509702-8c4b-44c2-bbf4-03cc0450d87d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:42.842348 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c4d0e834-9286-43c0-995e-606d9f017cba tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:42.852458 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c4d0e834-9286-43c0-995e-606d9f017cba tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.246437 May 26 17:00:42.852559 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1a509702-8c4b-44c2-bbf4-03cc0450d87d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:42.852729 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 442/891] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:42 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:42.857665 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1a509702-8c4b-44c2-bbf4-03cc0450d87d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:42.859755 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-1a509702-8c4b-44c2-bbf4-03cc0450d87d tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1671 microversion: 2.20 time: 0.249427 May 26 17:00:42.860405 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 450/892] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:42 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1671 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:42.919635 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-12b05ca3-c12b-4cee-a515-61bfb70081d7 req-3ec93208-1245-4f78-8630-b3a521170cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "843b1744-ddc9-4aa5-800e-5e906b2b45e9", "tag": "26d45251-b7a1-4efa-b018-af29198a4168"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:42.928568 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-12b05ca3-c12b-4cee-a515-61bfb70081d7 req-3ec93208-1245-4f78-8630-b3a521170cf9 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:42.929069 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-12b05ca3-c12b-4cee-a515-61bfb70081d7 req-3ec93208-1245-4f78-8630-b3a521170cf9 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:42.944248 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-12b05ca3-c12b-4cee-a515-61bfb70081d7 req-3ec93208-1245-4f78-8630-b3a521170cf9 service nova] Creating event network-changed:26d45251-b7a1-4efa-b018-af29198a4168 for instance 843b1744-ddc9-4aa5-800e-5e906b2b45e9 on hv-cinder-83607 May 26 17:00:42.949539 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-12b05ca3-c12b-4cee-a515-61bfb70081d7 req-3ec93208-1245-4f78-8630-b3a521170cf9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033529 May 26 17:00:42.950136 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 443/893] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:43.870138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-aa2923b7-fd77-4798-9c9c-de00f1c82b19 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:43.870787 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-aa2923b7-fd77-4798-9c9c-de00f1c82b19 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:43.872706 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:43.873265 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=6 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:43.879426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-aa2923b7-fd77-4798-9c9c-de00f1c82b19 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:43.879683 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-55fbe906-1e05-4288-8ed4-982522433e2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:43.880150 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-aa2923b7-fd77-4798-9c9c-de00f1c82b19 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:43.880434 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-55fbe906-1e05-4288-8ed4-982522433e2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:43.880667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-aa2923b7-fd77-4798-9c9c-de00f1c82b19 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:43.881059 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-aa2923b7-fd77-4798-9c9c-de00f1c82b19 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:43.887442 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-55fbe906-1e05-4288-8ed4-982522433e2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:43.887892 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-55fbe906-1e05-4288-8ed4-982522433e2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:43.888663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-55fbe906-1e05-4288-8ed4-982522433e2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:43.889102 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-55fbe906-1e05-4288-8ed4-982522433e2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:44.083862 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-aa2923b7-fd77-4798-9c9c-de00f1c82b19 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:44.087216 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-55fbe906-1e05-4288-8ed4-982522433e2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:44.092068 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-aa2923b7-fd77-4798-9c9c-de00f1c82b19 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.225871 May 26 17:00:44.092665 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 451/894] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:43 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:44.095997 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-55fbe906-1e05-4288-8ed4-982522433e2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:44.097651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-55fbe906-1e05-4288-8ed4-982522433e2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:44.098816 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-55fbe906-1e05-4288-8ed4-982522433e2e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1673 microversion: 2.20 time: 0.223623 May 26 17:00:44.099637 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 444/895] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:43 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1673 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:00:44.339169 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4ee640bd-1829-48b9-8d78-62a3365471f7 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:44.340167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4ee640bd-1829-48b9-8d78-62a3365471f7 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:44.347066 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4ee640bd-1829-48b9-8d78-62a3365471f7 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:44.347524 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4ee640bd-1829-48b9-8d78-62a3365471f7 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:44.348552 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4ee640bd-1829-48b9-8d78-62a3365471f7 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:44.348995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4ee640bd-1829-48b9-8d78-62a3365471f7 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:44.384664 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4ee640bd-1829-48b9-8d78-62a3365471f7 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049500 May 26 17:00:44.385507 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 452/896] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 17:00:44 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:44.526347 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c451e019-d297-411c-94ca-49c787c8fb1d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:44.526841 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c451e019-d297-411c-94ca-49c787c8fb1d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:44.534148 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c451e019-d297-411c-94ca-49c787c8fb1d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:44.534603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c451e019-d297-411c-94ca-49c787c8fb1d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:44.535414 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c451e019-d297-411c-94ca-49c787c8fb1d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:44.535855 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c451e019-d297-411c-94ca-49c787c8fb1d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:44.567934 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c451e019-d297-411c-94ca-49c787c8fb1d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments/a442e33c-4ba9-45dc-ae01-56025f4187e7" status: 200 len: 194 microversion: 2.1 time: 0.045613 May 26 17:00:44.568575 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 445/897] 10.222.0.48 () {58 vars in 1412 bytes} [Thu May 26 17:00:44 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments/a442e33c-4ba9-45dc-ae01-56025f4187e7 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:44.578648 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-376e9426-4a7e-4c25-842d-a17d8d49eb49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:44.579144 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-376e9426-4a7e-4c25-842d-a17d8d49eb49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:44.585452 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-376e9426-4a7e-4c25-842d-a17d8d49eb49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:44.585907 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-376e9426-4a7e-4c25-842d-a17d8d49eb49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:44.586683 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-376e9426-4a7e-4c25-842d-a17d8d49eb49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:44.587183 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-376e9426-4a7e-4c25-842d-a17d8d49eb49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:44.691200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-376e9426-4a7e-4c25-842d-a17d8d49eb49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lazy-loading 'services' on Instance uuid 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:00:44.943874 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-376e9426-4a7e-4c25-842d-a17d8d49eb49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments/a442e33c-4ba9-45dc-ae01-56025f4187e7" status: 202 len: 0 microversion: 2.1 time: 0.369241 May 26 17:00:44.944486 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 453/898] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 26 17:00:44 2022] DELETE /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments/a442e33c-4ba9-45dc-ae01-56025f4187e7 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:00:45.122565 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f061bc8a-140c-4f22-90ba-b877674551e6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:45.123280 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f061bc8a-140c-4f22-90ba-b877674551e6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:45.125899 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b5f37667-7040-41fb-906d-758e54f361a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:45.126664 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b5f37667-7040-41fb-906d-758e54f361a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:45.130312 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=4 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:45.133402 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b5f37667-7040-41fb-906d-758e54f361a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:45.133865 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b5f37667-7040-41fb-906d-758e54f361a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:45.134646 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b5f37667-7040-41fb-906d-758e54f361a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:45.135089 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b5f37667-7040-41fb-906d-758e54f361a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:45.136438 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f061bc8a-140c-4f22-90ba-b877674551e6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:45.136902 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f061bc8a-140c-4f22-90ba-b877674551e6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:45.137745 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f061bc8a-140c-4f22-90ba-b877674551e6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:45.138179 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f061bc8a-140c-4f22-90ba-b877674551e6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:45.157146 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:45.332646 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b5f37667-7040-41fb-906d-758e54f361a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:45.339829 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f061bc8a-140c-4f22-90ba-b877674551e6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:45.342231 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b5f37667-7040-41fb-906d-758e54f361a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:45.344633 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b5f37667-7040-41fb-906d-758e54f361a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:45.346297 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b5f37667-7040-41fb-906d-758e54f361a2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.230314 May 26 17:00:45.346978 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 454/899] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:45 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:00:45.348142 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f061bc8a-140c-4f22-90ba-b877674551e6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.242495 May 26 17:00:45.348714 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 446/900] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:45 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:46.365604 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-763b41f3-c86e-4001-9325-652d11cf7c88 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:46.366144 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-763b41f3-c86e-4001-9325-652d11cf7c88 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:46.369639 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-42ff85f9-c1de-4425-84c3-b0629e67487c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:46.370264 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-42ff85f9-c1de-4425-84c3-b0629e67487c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:46.372761 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-763b41f3-c86e-4001-9325-652d11cf7c88 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:46.374806 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-763b41f3-c86e-4001-9325-652d11cf7c88 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:46.374806 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-763b41f3-c86e-4001-9325-652d11cf7c88 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:46.375022 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-763b41f3-c86e-4001-9325-652d11cf7c88 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:46.377652 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42ff85f9-c1de-4425-84c3-b0629e67487c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:46.378120 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42ff85f9-c1de-4425-84c3-b0629e67487c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:46.378897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42ff85f9-c1de-4425-84c3-b0629e67487c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:46.379340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-42ff85f9-c1de-4425-84c3-b0629e67487c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:46.581619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-763b41f3-c86e-4001-9325-652d11cf7c88 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:46.583956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:46.585073 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-42ff85f9-c1de-4425-84c3-b0629e67487c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:46.590676 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-763b41f3-c86e-4001-9325-652d11cf7c88 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:46.592203 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-763b41f3-c86e-4001-9325-652d11cf7c88 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:46.593224 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-42ff85f9-c1de-4425-84c3-b0629e67487c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.227357 May 26 17:00:46.593745 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 447/901] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:46 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:00:46.594186 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-763b41f3-c86e-4001-9325-652d11cf7c88 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.232766 May 26 17:00:46.594831 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 455/902] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:46 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:47.143980 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b36bc320-b727-4f25-86ee-6df6dcd8b70a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:47.144534 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b36bc320-b727-4f25-86ee-6df6dcd8b70a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:47.151444 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b36bc320-b727-4f25-86ee-6df6dcd8b70a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:47.152158 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b36bc320-b727-4f25-86ee-6df6dcd8b70a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:47.153188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b36bc320-b727-4f25-86ee-6df6dcd8b70a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:47.153815 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b36bc320-b727-4f25-86ee-6df6dcd8b70a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:47.214594 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b36bc320-b727-4f25-86ee-6df6dcd8b70a tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments/5db00150-15b6-4c52-989a-e77101eef4bf" status: 200 len: 194 microversion: 2.1 time: 0.074878 May 26 17:00:47.222337 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 448/903] 10.222.0.48 () {58 vars in 1412 bytes} [Thu May 26 17:00:47 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments/5db00150-15b6-4c52-989a-e77101eef4bf => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:47.228200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-825c097d-bea6-4a0c-95c3-ad1668def5ab tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:47.228963 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-825c097d-bea6-4a0c-95c3-ad1668def5ab tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:47.236008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-825c097d-bea6-4a0c-95c3-ad1668def5ab tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:47.236715 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-825c097d-bea6-4a0c-95c3-ad1668def5ab tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:47.237676 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-825c097d-bea6-4a0c-95c3-ad1668def5ab tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:47.238282 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-825c097d-bea6-4a0c-95c3-ad1668def5ab tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:47.343770 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-825c097d-bea6-4a0c-95c3-ad1668def5ab tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lazy-loading 'services' on Instance uuid 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:00:47.590860 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-825c097d-bea6-4a0c-95c3-ad1668def5ab tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments/5db00150-15b6-4c52-989a-e77101eef4bf" status: 202 len: 0 microversion: 2.1 time: 0.368311 May 26 17:00:47.595898 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 456/904] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 26 17:00:47 2022] DELETE /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments/5db00150-15b6-4c52-989a-e77101eef4bf => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:00:47.613816 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-84400c2f-1133-47db-b3d8-cfb073eb13cf tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:47.615080 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-84400c2f-1133-47db-b3d8-cfb073eb13cf tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:47.631444 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-84400c2f-1133-47db-b3d8-cfb073eb13cf tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:47.633818 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-84400c2f-1133-47db-b3d8-cfb073eb13cf tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:47.634808 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-84400c2f-1133-47db-b3d8-cfb073eb13cf tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:47.635451 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-84400c2f-1133-47db-b3d8-cfb073eb13cf tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:47.636593 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-293ca40c-4fa5-4914-96c3-7e3743459624 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:47.640539 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-293ca40c-4fa5-4914-96c3-7e3743459624 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:47.657182 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-293ca40c-4fa5-4914-96c3-7e3743459624 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:47.660065 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-293ca40c-4fa5-4914-96c3-7e3743459624 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:47.661071 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-293ca40c-4fa5-4914-96c3-7e3743459624 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:47.663493 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-293ca40c-4fa5-4914-96c3-7e3743459624 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:47.944637 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-293ca40c-4fa5-4914-96c3-7e3743459624 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:47.954278 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-293ca40c-4fa5-4914-96c3-7e3743459624 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:47.956030 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-293ca40c-4fa5-4914-96c3-7e3743459624 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:47.957316 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-293ca40c-4fa5-4914-96c3-7e3743459624 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.335659 May 26 17:00:47.958963 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-84400c2f-1133-47db-b3d8-cfb073eb13cf tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:47.967035 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-84400c2f-1133-47db-b3d8-cfb073eb13cf tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.361446 May 26 17:00:47.977435 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 449/905] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:47 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:47.977605 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 457/906] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:47 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:47.977729 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-d718535d-4f2c-4ef1-ab11-1dcf63955c17 req-0274e53b-0e87-4744-84be-d5aa87a947cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "843b1744-ddc9-4aa5-800e-5e906b2b45e9", "name": "network-vif-plugged", "status": "completed", "tag": "26d45251-b7a1-4efa-b018-af29198a4168"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:00:47.979681 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=96 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:47.984445 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-d718535d-4f2c-4ef1-ab11-1dcf63955c17 req-0274e53b-0e87-4744-84be-d5aa87a947cf service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:47.984953 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-d718535d-4f2c-4ef1-ab11-1dcf63955c17 req-0274e53b-0e87-4744-84be-d5aa87a947cf service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:47.997421 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-d718535d-4f2c-4ef1-ab11-1dcf63955c17 req-0274e53b-0e87-4744-84be-d5aa87a947cf service nova] Creating event network-vif-plugged:26d45251-b7a1-4efa-b018-af29198a4168 for instance 843b1744-ddc9-4aa5-800e-5e906b2b45e9 on hv-cinder-83607 May 26 17:00:48.010448 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-d718535d-4f2c-4ef1-ab11-1dcf63955c17 req-0274e53b-0e87-4744-84be-d5aa87a947cf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040071 May 26 17:00:48.011610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 450/907] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:00:48.979273 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-04c28d4a-da74-4dbe-ab05-8cd758d0dfb2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:48.979824 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-04c28d4a-da74-4dbe-ab05-8cd758d0dfb2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:48.989387 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-04c28d4a-da74-4dbe-ab05-8cd758d0dfb2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:48.990287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-04c28d4a-da74-4dbe-ab05-8cd758d0dfb2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:48.991344 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-04c28d4a-da74-4dbe-ab05-8cd758d0dfb2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:48.991869 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-04c28d4a-da74-4dbe-ab05-8cd758d0dfb2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:48.992576 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-432ef28a-2ff0-4d0e-804b-887abfd1b271 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:48.993358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-432ef28a-2ff0-4d0e-804b-887abfd1b271 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:49.006159 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-432ef28a-2ff0-4d0e-804b-887abfd1b271 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:49.006787 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-432ef28a-2ff0-4d0e-804b-887abfd1b271 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:49.007724 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-432ef28a-2ff0-4d0e-804b-887abfd1b271 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:49.008256 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-432ef28a-2ff0-4d0e-804b-887abfd1b271 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:49.244376 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-432ef28a-2ff0-4d0e-804b-887abfd1b271 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:49.254081 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-432ef28a-2ff0-4d0e-804b-887abfd1b271 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.266641 May 26 17:00:49.254680 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 451/908] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:48 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:49.262639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-04c28d4a-da74-4dbe-ab05-8cd758d0dfb2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:49.271804 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-04c28d4a-da74-4dbe-ab05-8cd758d0dfb2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:49.273495 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-04c28d4a-da74-4dbe-ab05-8cd758d0dfb2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:49.274876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-04c28d4a-da74-4dbe-ab05-8cd758d0dfb2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.299812 May 26 17:00:49.285630 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 458/909] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:48 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:00:50.273637 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a47e1c1e-e132-4e48-89ad-4b70b2276f13 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:50.274418 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a47e1c1e-e132-4e48-89ad-4b70b2276f13 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:50.282975 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a47e1c1e-e132-4e48-89ad-4b70b2276f13 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:50.283433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a47e1c1e-e132-4e48-89ad-4b70b2276f13 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:50.284222 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a47e1c1e-e132-4e48-89ad-4b70b2276f13 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:50.284668 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a47e1c1e-e132-4e48-89ad-4b70b2276f13 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:50.295194 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b16d68fb-02b6-4288-b36f-83ff4c79b674 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:50.297145 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b16d68fb-02b6-4288-b36f-83ff4c79b674 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:50.304436 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b16d68fb-02b6-4288-b36f-83ff4c79b674 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:50.305801 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b16d68fb-02b6-4288-b36f-83ff4c79b674 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:50.307048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b16d68fb-02b6-4288-b36f-83ff4c79b674 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:50.307588 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b16d68fb-02b6-4288-b36f-83ff4c79b674 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:50.518390 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a47e1c1e-e132-4e48-89ad-4b70b2276f13 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:50.521209 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b16d68fb-02b6-4288-b36f-83ff4c79b674 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:50.526722 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a47e1c1e-e132-4e48-89ad-4b70b2276f13 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.258244 May 26 17:00:50.527512 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 452/910] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:50 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:50.531616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b16d68fb-02b6-4288-b36f-83ff4c79b674 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:50.532370 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b16d68fb-02b6-4288-b36f-83ff4c79b674 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:50.533867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b16d68fb-02b6-4288-b36f-83ff4c79b674 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.243353 May 26 17:00:50.534778 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 459/911] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:50 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:51.546845 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-98022876-7c94-40da-ba92-e079138cbe5a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:51.547596 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-98022876-7c94-40da-ba92-e079138cbe5a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:51.555600 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-98022876-7c94-40da-ba92-e079138cbe5a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:51.555953 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-32b4892c-5077-4dfd-aadc-fd4e8706781c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:51.556422 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-98022876-7c94-40da-ba92-e079138cbe5a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:51.556770 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-32b4892c-5077-4dfd-aadc-fd4e8706781c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:51.556886 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-98022876-7c94-40da-ba92-e079138cbe5a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:51.557339 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-98022876-7c94-40da-ba92-e079138cbe5a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:51.565941 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:51.568452 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-32b4892c-5077-4dfd-aadc-fd4e8706781c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:51.568951 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-32b4892c-5077-4dfd-aadc-fd4e8706781c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:51.569928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-32b4892c-5077-4dfd-aadc-fd4e8706781c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:51.570550 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-32b4892c-5077-4dfd-aadc-fd4e8706781c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:51.801292 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-98022876-7c94-40da-ba92-e079138cbe5a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:51.804563 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-98022876-7c94-40da-ba92-e079138cbe5a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.262154 May 26 17:00:51.804766 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-32b4892c-5077-4dfd-aadc-fd4e8706781c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:51.815653 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 453/912] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:51 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:51.828604 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-32b4892c-5077-4dfd-aadc-fd4e8706781c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:51.831187 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-32b4892c-5077-4dfd-aadc-fd4e8706781c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:51.832980 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-32b4892c-5077-4dfd-aadc-fd4e8706781c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.281829 May 26 17:00:51.833630 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 460/913] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:51 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:52.822359 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-922a0854-32d5-4e2b-8dc5-1652fc1cd368 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:52.823218 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-922a0854-32d5-4e2b-8dc5-1652fc1cd368 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:52.830218 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-922a0854-32d5-4e2b-8dc5-1652fc1cd368 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:52.830916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-922a0854-32d5-4e2b-8dc5-1652fc1cd368 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:52.831700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-922a0854-32d5-4e2b-8dc5-1652fc1cd368 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:52.832145 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-922a0854-32d5-4e2b-8dc5-1652fc1cd368 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:52.854646 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ef270b62-96ab-401a-9897-79ac729c4c72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:52.855982 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ef270b62-96ab-401a-9897-79ac729c4c72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:52.866549 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ef270b62-96ab-401a-9897-79ac729c4c72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:52.866549 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ef270b62-96ab-401a-9897-79ac729c4c72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:52.867883 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ef270b62-96ab-401a-9897-79ac729c4c72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:52.868797 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ef270b62-96ab-401a-9897-79ac729c4c72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:53.124372 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-922a0854-32d5-4e2b-8dc5-1652fc1cd368 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:53.133742 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-922a0854-32d5-4e2b-8dc5-1652fc1cd368 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.315269 May 26 17:00:53.143686 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 454/914] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:52 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:53.169066 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ef270b62-96ab-401a-9897-79ac729c4c72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:53.178059 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ef270b62-96ab-401a-9897-79ac729c4c72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:53.179584 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ef270b62-96ab-401a-9897-79ac729c4c72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:53.180787 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ef270b62-96ab-401a-9897-79ac729c4c72 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.330811 May 26 17:00:53.181357 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 461/915] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:52 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:00:54.152325 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7d857140-f269-4d0a-8887-e8e11f717c53 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:54.153023 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7d857140-f269-4d0a-8887-e8e11f717c53 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:54.160440 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d857140-f269-4d0a-8887-e8e11f717c53 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:54.160975 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d857140-f269-4d0a-8887-e8e11f717c53 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:54.161858 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d857140-f269-4d0a-8887-e8e11f717c53 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:54.162369 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7d857140-f269-4d0a-8887-e8e11f717c53 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:54.201313 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-51881729-d308-4380-a665-d9780bc34a67 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:54.202804 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-51881729-d308-4380-a665-d9780bc34a67 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:54.219672 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-51881729-d308-4380-a665-d9780bc34a67 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:54.220574 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-51881729-d308-4380-a665-d9780bc34a67 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:54.221635 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-51881729-d308-4380-a665-d9780bc34a67 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:54.222290 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-51881729-d308-4380-a665-d9780bc34a67 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:54.357333 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7d857140-f269-4d0a-8887-e8e11f717c53 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:54.365906 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7d857140-f269-4d0a-8887-e8e11f717c53 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.218146 May 26 17:00:54.367207 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 455/916] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:54 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:54.412167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-51881729-d308-4380-a665-d9780bc34a67 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:54.424430 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-51881729-d308-4380-a665-d9780bc34a67 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:54.426203 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-51881729-d308-4380-a665-d9780bc34a67 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:54.427544 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-51881729-d308-4380-a665-d9780bc34a67 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.231834 May 26 17:00:54.436277 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 462/917] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:54 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:00:55.383823 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1d5adcda-37c1-41a0-980f-52d22a791efb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:55.384413 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1d5adcda-37c1-41a0-980f-52d22a791efb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:55.391173 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d5adcda-37c1-41a0-980f-52d22a791efb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:55.391812 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d5adcda-37c1-41a0-980f-52d22a791efb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:55.392612 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d5adcda-37c1-41a0-980f-52d22a791efb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:55.393061 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d5adcda-37c1-41a0-980f-52d22a791efb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:55.447072 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-34c119f9-6e6c-40f6-aa6b-0bf525088caa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:55.448438 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-34c119f9-6e6c-40f6-aa6b-0bf525088caa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:55.456291 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-34c119f9-6e6c-40f6-aa6b-0bf525088caa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:55.456845 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-34c119f9-6e6c-40f6-aa6b-0bf525088caa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:55.457908 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-34c119f9-6e6c-40f6-aa6b-0bf525088caa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:55.458379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-34c119f9-6e6c-40f6-aa6b-0bf525088caa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:55.597149 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1d5adcda-37c1-41a0-980f-52d22a791efb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:55.598847 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1d5adcda-37c1-41a0-980f-52d22a791efb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.219132 May 26 17:00:55.600901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 456/918] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:55 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:55.649412 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-34c119f9-6e6c-40f6-aa6b-0bf525088caa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:55.659491 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-34c119f9-6e6c-40f6-aa6b-0bf525088caa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:55.661063 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-34c119f9-6e6c-40f6-aa6b-0bf525088caa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:55.662472 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-34c119f9-6e6c-40f6-aa6b-0bf525088caa tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.219250 May 26 17:00:55.663453 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 463/919] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:55 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:00:56.617690 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3201345d-f7db-4cbd-b126-c5c9f640944c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:56.618275 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3201345d-f7db-4cbd-b126-c5c9f640944c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:56.625378 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3201345d-f7db-4cbd-b126-c5c9f640944c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:56.625834 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3201345d-f7db-4cbd-b126-c5c9f640944c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:56.626602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3201345d-f7db-4cbd-b126-c5c9f640944c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:56.627042 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3201345d-f7db-4cbd-b126-c5c9f640944c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:56.683492 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c93a251a-6eef-46b9-9543-f6bc6c314c4c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:56.684105 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c93a251a-6eef-46b9-9543-f6bc6c314c4c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:56.692052 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c93a251a-6eef-46b9-9543-f6bc6c314c4c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:56.693042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c93a251a-6eef-46b9-9543-f6bc6c314c4c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:56.694264 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c93a251a-6eef-46b9-9543-f6bc6c314c4c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:56.694930 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c93a251a-6eef-46b9-9543-f6bc6c314c4c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:56.802634 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3201345d-f7db-4cbd-b126-c5c9f640944c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:56.810353 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3201345d-f7db-4cbd-b126-c5c9f640944c tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.196704 May 26 17:00:56.811755 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 457/920] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:56 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:56.846944 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c93a251a-6eef-46b9-9543-f6bc6c314c4c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:56.855166 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c93a251a-6eef-46b9-9543-f6bc6c314c4c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:56.856679 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c93a251a-6eef-46b9-9543-f6bc6c314c4c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:56.858396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c93a251a-6eef-46b9-9543-f6bc6c314c4c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.178510 May 26 17:00:56.858966 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 464/921] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:56 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:00:57.828465 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-528fa224-4c9c-4b6d-a1e6-b3d17a6f1799 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:57.829070 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-528fa224-4c9c-4b6d-a1e6-b3d17a6f1799 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:57.835606 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-528fa224-4c9c-4b6d-a1e6-b3d17a6f1799 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:57.836048 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-528fa224-4c9c-4b6d-a1e6-b3d17a6f1799 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:57.836802 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-528fa224-4c9c-4b6d-a1e6-b3d17a6f1799 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:57.837236 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-528fa224-4c9c-4b6d-a1e6-b3d17a6f1799 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:57.876434 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-edf45a7c-bb0a-4064-94c5-4e13986bb68a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:57.877187 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-edf45a7c-bb0a-4064-94c5-4e13986bb68a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:57.884178 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-edf45a7c-bb0a-4064-94c5-4e13986bb68a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:57.884633 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-edf45a7c-bb0a-4064-94c5-4e13986bb68a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:57.885433 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-edf45a7c-bb0a-4064-94c5-4e13986bb68a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:57.885871 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-edf45a7c-bb0a-4064-94c5-4e13986bb68a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:58.027989 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-528fa224-4c9c-4b6d-a1e6-b3d17a6f1799 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:58.035579 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-528fa224-4c9c-4b6d-a1e6-b3d17a6f1799 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.211606 May 26 17:00:58.036162 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 458/922] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:57 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:58.054886 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-edf45a7c-bb0a-4064-94c5-4e13986bb68a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:58.063492 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-edf45a7c-bb0a-4064-94c5-4e13986bb68a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:58.065028 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-edf45a7c-bb0a-4064-94c5-4e13986bb68a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:58.066231 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-edf45a7c-bb0a-4064-94c5-4e13986bb68a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.194195 May 26 17:00:58.066817 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 465/923] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:57 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:00:59.052335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-674b2445-6212-4a7a-96ed-b0339d99cdd6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:59.052973 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-674b2445-6212-4a7a-96ed-b0339d99cdd6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:59.059456 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-674b2445-6212-4a7a-96ed-b0339d99cdd6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:59.059903 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-674b2445-6212-4a7a-96ed-b0339d99cdd6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:59.061336 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-674b2445-6212-4a7a-96ed-b0339d99cdd6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:59.061787 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-674b2445-6212-4a7a-96ed-b0339d99cdd6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:59.084323 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-808fa88f-1c6d-42af-a3cf-fdd25ce52da4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:59.085275 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-808fa88f-1c6d-42af-a3cf-fdd25ce52da4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:59.091980 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-808fa88f-1c6d-42af-a3cf-fdd25ce52da4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:59.092532 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-808fa88f-1c6d-42af-a3cf-fdd25ce52da4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:59.093402 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-808fa88f-1c6d-42af-a3cf-fdd25ce52da4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:59.093830 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-808fa88f-1c6d-42af-a3cf-fdd25ce52da4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:59.246696 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-674b2445-6212-4a7a-96ed-b0339d99cdd6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:59.254230 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-674b2445-6212-4a7a-96ed-b0339d99cdd6 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1318 microversion: 2.1 time: 0.205808 May 26 17:00:59.254912 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 459/924] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:00:59 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:00:59.272840 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-808fa88f-1c6d-42af-a3cf-fdd25ce52da4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:59.281621 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-808fa88f-1c6d-42af-a3cf-fdd25ce52da4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:59.283120 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-808fa88f-1c6d-42af-a3cf-fdd25ce52da4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:00:59.284274 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-808fa88f-1c6d-42af-a3cf-fdd25ce52da4 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.204094 May 26 17:00:59.284825 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 466/925] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:00:59 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:00:59.402167 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-68a5a36c-4bba-4e16-a267-dab6b3c84d28 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:59.403101 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-68a5a36c-4bba-4e16-a267-dab6b3c84d28 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:59.409787 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-68a5a36c-4bba-4e16-a267-dab6b3c84d28 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:59.410242 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-68a5a36c-4bba-4e16-a267-dab6b3c84d28 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:59.411010 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-68a5a36c-4bba-4e16-a267-dab6b3c84d28 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:59.411450 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-68a5a36c-4bba-4e16-a267-dab6b3c84d28 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:59.441335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-68a5a36c-4bba-4e16-a267-dab6b3c84d28 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042994 May 26 17:00:59.442146 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 460/926] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 17:00:59 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 17:00:59.551889 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-fac2fc7e-6c81-4312-b704-fca26b8b8100 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:59.552889 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-fac2fc7e-6c81-4312-b704-fca26b8b8100 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:59.559512 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fac2fc7e-6c81-4312-b704-fca26b8b8100 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:59.559974 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fac2fc7e-6c81-4312-b704-fca26b8b8100 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:59.560743 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fac2fc7e-6c81-4312-b704-fca26b8b8100 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:59.561178 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fac2fc7e-6c81-4312-b704-fca26b8b8100 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:59.591694 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-fac2fc7e-6c81-4312-b704-fca26b8b8100 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043587 May 26 17:00:59.592911 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 467/927] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 17:00:59 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 17:00:59.653173 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0419d1db-1a87-449d-823e-fd317edabf51 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:00:59.653717 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0419d1db-1a87-449d-823e-fd317edabf51 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:00:59.660550 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0419d1db-1a87-449d-823e-fd317edabf51 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:59.661005 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0419d1db-1a87-449d-823e-fd317edabf51 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:59.661946 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0419d1db-1a87-449d-823e-fd317edabf51 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:00:59.662389 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0419d1db-1a87-449d-823e-fd317edabf51 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:00:59.687328 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0419d1db-1a87-449d-823e-fd317edabf51 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:01:00.024062 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0419d1db-1a87-449d-823e-fd317edabf51 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 204 len: 0 microversion: 2.1 time: 0.374451 May 26 17:01:00.024743 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 461/928] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:00:59 2022] DELETE /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:01:00.032863 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4420f988-0879-484e-b3c5-9f48134d9c49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:00.036452 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4420f988-0879-484e-b3c5-9f48134d9c49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:00.039944 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4420f988-0879-484e-b3c5-9f48134d9c49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:00.040588 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4420f988-0879-484e-b3c5-9f48134d9c49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:00.041461 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4420f988-0879-484e-b3c5-9f48134d9c49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:00.041966 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4420f988-0879-484e-b3c5-9f48134d9c49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:00.169726 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4420f988-0879-484e-b3c5-9f48134d9c49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:00.177357 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4420f988-0879-484e-b3c5-9f48134d9c49 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1673 microversion: 2.1 time: 0.148389 May 26 17:01:00.177915 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 468/929] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:00 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:00.271749 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a82b459f-dce6-4e59-8120-6da52d66899e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:00.272449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a82b459f-dce6-4e59-8120-6da52d66899e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:00.279261 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a82b459f-dce6-4e59-8120-6da52d66899e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:00.279707 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a82b459f-dce6-4e59-8120-6da52d66899e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:00.280468 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a82b459f-dce6-4e59-8120-6da52d66899e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:00.280901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a82b459f-dce6-4e59-8120-6da52d66899e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:00.285243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:00.302561 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c18f3a76-88e2-4e94-8dfa-107d28ce0957 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:00.303178 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c18f3a76-88e2-4e94-8dfa-107d28ce0957 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:00.309427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c18f3a76-88e2-4e94-8dfa-107d28ce0957 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:00.309893 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c18f3a76-88e2-4e94-8dfa-107d28ce0957 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:00.311297 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c18f3a76-88e2-4e94-8dfa-107d28ce0957 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:00.311753 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c18f3a76-88e2-4e94-8dfa-107d28ce0957 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:00.488968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a82b459f-dce6-4e59-8120-6da52d66899e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:00.492542 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c18f3a76-88e2-4e94-8dfa-107d28ce0957 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:00.499840 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a82b459f-dce6-4e59-8120-6da52d66899e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1506 microversion: 2.1 time: 0.232189 May 26 17:01:00.500471 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 462/930] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:00 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:00.502563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c18f3a76-88e2-4e94-8dfa-107d28ce0957 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:00.504183 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c18f3a76-88e2-4e94-8dfa-107d28ce0957 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:00.505471 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c18f3a76-88e2-4e94-8dfa-107d28ce0957 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.206914 May 26 17:01:00.506091 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 469/931] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:01:00 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:01:01.195184 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c161449f-fe65-4505-a3b0-ad099400a5f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:01.195901 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c161449f-fe65-4505-a3b0-ad099400a5f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:01.202788 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c161449f-fe65-4505-a3b0-ad099400a5f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:01.203327 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c161449f-fe65-4505-a3b0-ad099400a5f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:01.204237 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c161449f-fe65-4505-a3b0-ad099400a5f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:01.204679 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c161449f-fe65-4505-a3b0-ad099400a5f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:01.524436 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b07d3c06-d0ea-4c06-a19c-b1f4fc09f5f6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:01.525037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b07d3c06-d0ea-4c06-a19c-b1f4fc09f5f6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:01.532342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b07d3c06-d0ea-4c06-a19c-b1f4fc09f5f6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:01.532796 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b07d3c06-d0ea-4c06-a19c-b1f4fc09f5f6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:01.533635 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b07d3c06-d0ea-4c06-a19c-b1f4fc09f5f6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:01.534082 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b07d3c06-d0ea-4c06-a19c-b1f4fc09f5f6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:01.556557 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c161449f-fe65-4505-a3b0-ad099400a5f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:01.565402 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c161449f-fe65-4505-a3b0-ad099400a5f1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1673 microversion: 2.1 time: 0.374250 May 26 17:01:01.565993 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 463/932] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:01 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1673 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:01.673139 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b07d3c06-d0ea-4c06-a19c-b1f4fc09f5f6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:01.681224 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b07d3c06-d0ea-4c06-a19c-b1f4fc09f5f6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:01.682840 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b07d3c06-d0ea-4c06-a19c-b1f4fc09f5f6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:01.684114 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b07d3c06-d0ea-4c06-a19c-b1f4fc09f5f6 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.163574 May 26 17:01:01.684771 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 470/933] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:01:01 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:01:01.860865 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-264b9c36-1a27-4b28-b506-cb8469797cf6 req-ea7ba402-5013-4629-ba10-488b004a951d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ca388b-87f7-46b3-81f0-5e7d06e9dcc1", "name": "network-vif-plugged", "status": "completed", "tag": "17153ebf-8de6-4b1d-bafd-f2c2e8580998"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:01.870080 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-264b9c36-1a27-4b28-b506-cb8469797cf6 req-ea7ba402-5013-4629-ba10-488b004a951d service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:01.873247 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-264b9c36-1a27-4b28-b506-cb8469797cf6 req-ea7ba402-5013-4629-ba10-488b004a951d service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:01.883529 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-264b9c36-1a27-4b28-b506-cb8469797cf6 req-ea7ba402-5013-4629-ba10-488b004a951d service nova] Creating event network-vif-plugged:17153ebf-8de6-4b1d-bafd-f2c2e8580998 for instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 on hv-cinder-83607 May 26 17:01:01.888529 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-264b9c36-1a27-4b28-b506-cb8469797cf6 req-ea7ba402-5013-4629-ba10-488b004a951d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032761 May 26 17:01:01.889841 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 464/934] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:02.583664 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e9797f10-6f72-4e99-b79b-fccd7edda984 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:02.586383 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e9797f10-6f72-4e99-b79b-fccd7edda984 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:02.594687 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e9797f10-6f72-4e99-b79b-fccd7edda984 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:02.595233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e9797f10-6f72-4e99-b79b-fccd7edda984 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:02.596043 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e9797f10-6f72-4e99-b79b-fccd7edda984 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:02.596508 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e9797f10-6f72-4e99-b79b-fccd7edda984 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:02.705293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8b6f147b-0b10-4b52-8beb-6a2f7d9c4963 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:02.706005 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8b6f147b-0b10-4b52-8beb-6a2f7d9c4963 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:02.712597 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8b6f147b-0b10-4b52-8beb-6a2f7d9c4963 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:02.713347 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8b6f147b-0b10-4b52-8beb-6a2f7d9c4963 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:02.714299 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8b6f147b-0b10-4b52-8beb-6a2f7d9c4963 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:02.714949 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8b6f147b-0b10-4b52-8beb-6a2f7d9c4963 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:02.738305 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e9797f10-6f72-4e99-b79b-fccd7edda984 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:02.740600 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:02.746988 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e9797f10-6f72-4e99-b79b-fccd7edda984 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1673 microversion: 2.1 time: 0.167492 May 26 17:01:02.749657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 471/935] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:02 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:02.852777 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8b6f147b-0b10-4b52-8beb-6a2f7d9c4963 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:02.861013 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8b6f147b-0b10-4b52-8beb-6a2f7d9c4963 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:02.866572 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8b6f147b-0b10-4b52-8beb-6a2f7d9c4963 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:02.866572 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8b6f147b-0b10-4b52-8beb-6a2f7d9c4963 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.164656 May 26 17:01:02.866572 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 465/936] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:01:02 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:01:03.611575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-8d9a8407-ce60-4edb-b13e-4a8370bfa643 req-f8c6e302-ac68-4695-ba0e-b171ecbeb294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c09b3b4-c5ad-40d6-a92e-66fccb618e11", "name": "network-vif-deleted", "tag": "3deb4b98-258a-4325-9a71-e08fb22b0d5d"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:03.623112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-8d9a8407-ce60-4edb-b13e-4a8370bfa643 req-f8c6e302-ac68-4695-ba0e-b171ecbeb294 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:03.623575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-8d9a8407-ce60-4edb-b13e-4a8370bfa643 req-f8c6e302-ac68-4695-ba0e-b171ecbeb294 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:03.635495 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-8d9a8407-ce60-4edb-b13e-4a8370bfa643 req-f8c6e302-ac68-4695-ba0e-b171ecbeb294 service nova] Creating event network-vif-deleted:3deb4b98-258a-4325-9a71-e08fb22b0d5d for instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 on hv-cinder-83607 May 26 17:01:03.641489 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-8d9a8407-ce60-4edb-b13e-4a8370bfa643 req-f8c6e302-ac68-4695-ba0e-b171ecbeb294 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033476 May 26 17:01:03.642378 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 472/937] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:03.766672 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7db423a0-0052-4c4d-8897-a20b2d278b43 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:03.767311 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7db423a0-0052-4c4d-8897-a20b2d278b43 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:03.773811 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7db423a0-0052-4c4d-8897-a20b2d278b43 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:03.774257 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7db423a0-0052-4c4d-8897-a20b2d278b43 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:03.775040 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7db423a0-0052-4c4d-8897-a20b2d278b43 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:03.775596 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7db423a0-0052-4c4d-8897-a20b2d278b43 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:03.840666 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7db423a0-0052-4c4d-8897-a20b2d278b43 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:03.848419 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7db423a0-0052-4c4d-8897-a20b2d278b43 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1605 microversion: 2.1 time: 0.088009 May 26 17:01:03.848995 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 466/938] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:03 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1605 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:03.883856 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-87cb1934-e086-4a99-886e-ec989d5876e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:03.884607 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-87cb1934-e086-4a99-886e-ec989d5876e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:03.891995 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-87cb1934-e086-4a99-886e-ec989d5876e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:03.892478 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-87cb1934-e086-4a99-886e-ec989d5876e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:03.893249 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-87cb1934-e086-4a99-886e-ec989d5876e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:03.893713 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-87cb1934-e086-4a99-886e-ec989d5876e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:04.030091 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-87cb1934-e086-4a99-886e-ec989d5876e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:04.038503 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-87cb1934-e086-4a99-886e-ec989d5876e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:04.040103 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-87cb1934-e086-4a99-886e-ec989d5876e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:04.041522 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-87cb1934-e086-4a99-886e-ec989d5876e2 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.161892 May 26 17:01:04.042346 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 473/939] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:01:03 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:01:04.866749 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ee3e895e-b632-4ae7-9dbe-cf9770f20468 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:04.867360 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ee3e895e-b632-4ae7-9dbe-cf9770f20468 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:04.873711 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee3e895e-b632-4ae7-9dbe-cf9770f20468 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:04.874211 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee3e895e-b632-4ae7-9dbe-cf9770f20468 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:04.874988 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee3e895e-b632-4ae7-9dbe-cf9770f20468 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:04.875520 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee3e895e-b632-4ae7-9dbe-cf9770f20468 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:04.908437 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee3e895e-b632-4ae7-9dbe-cf9770f20468 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:04.908900 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ee3e895e-b632-4ae7-9dbe-cf9770f20468 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:04.909397 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-ee3e895e-b632-4ae7-9dbe-cf9770f20468 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lazy-loading 'fault' on Instance uuid 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:01:04.953054 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ee3e895e-b632-4ae7-9dbe-cf9770f20468 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5684eb0dd3141f5a25b61aafedbe865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89a7299f01984027a505aa43d96e07b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:04.962606 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ee3e895e-b632-4ae7-9dbe-cf9770f20468 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 200 len: 1325 microversion: 2.1 time: 0.100364 May 26 17:01:04.963609 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 467/940] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:04 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 1325 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:05.061440 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a386e08e-ca3a-4a7b-8fb6-de9ae6eac566 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:05.062170 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a386e08e-ca3a-4a7b-8fb6-de9ae6eac566 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:05.069335 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a386e08e-ca3a-4a7b-8fb6-de9ae6eac566 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:05.069960 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a386e08e-ca3a-4a7b-8fb6-de9ae6eac566 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:05.070752 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a386e08e-ca3a-4a7b-8fb6-de9ae6eac566 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:05.071233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a386e08e-ca3a-4a7b-8fb6-de9ae6eac566 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:05.210065 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a386e08e-ca3a-4a7b-8fb6-de9ae6eac566 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:05.218915 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a386e08e-ca3a-4a7b-8fb6-de9ae6eac566 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:05.220653 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a386e08e-ca3a-4a7b-8fb6-de9ae6eac566 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:05.221631 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a386e08e-ca3a-4a7b-8fb6-de9ae6eac566 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.164579 May 26 17:01:05.222193 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 474/941] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:01:05 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:01:05.981610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-69621d1a-62eb-4fcf-b012-ccfc73440bf1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:05.982164 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-69621d1a-62eb-4fcf-b012-ccfc73440bf1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:05.988952 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-69621d1a-62eb-4fcf-b012-ccfc73440bf1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:05.989443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-69621d1a-62eb-4fcf-b012-ccfc73440bf1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:05.990219 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-69621d1a-62eb-4fcf-b012-ccfc73440bf1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:05.990661 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-69621d1a-62eb-4fcf-b012-ccfc73440bf1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:06.005375 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-69621d1a-62eb-4fcf-b012-ccfc73440bf1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] HTTP exception thrown: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-69621d1a-62eb-4fcf-b012-ccfc73440bf1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Request method failure captured: May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 HTTP/1.1 May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7CM4fldsHDPgaRLTByjN4M_RTZa9UrovvQY7c9sUtwKdbMkDUvbFos_HFvNUmjAZIlQj0sT963_vZ0gwTkb1eub2bQ8hyZzwwP6YAfWsit3x-0xEiocaTtHPSAbAE4k9J_x81wGbCNE5wvKAy4HUwwmLGer77t-ZBE04EYNVOHozzc May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 89a7299f01984027a505aa43d96e07b3 May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeTestJSON-378673516 May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:01:06.007107 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:01:06.008535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89a7299f01984027a505aa43d96e07b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89a7299f01984027a505aa43d96e07b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_89a7299f01984027a505aa43d96e07b3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/89a7299f01984027a505aa43d96e07b3"}]}] May 26 17:01:06.008535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeTestJSON-378673516 May 26 17:01:06.008535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 89a7299f01984027a505aa43d96e07b3 May 26 17:01:06.008535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeTestJSON-378673516 May 26 17:01:06.008535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeTestJSON-378673516-project May 26 17:01:06.008535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:01:06.008535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:01:06.008535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: d5684eb0dd3141f5a25b61aafedbe865 May 26 17:01:06.008535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeTestJSON-378673516-project May 26 17:01:06.008535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 17:01:06.008535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. May 26 17:01:06.008535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': '8c09b3b4-c5ad-40d6-a92e-66fccb618e11'} May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:01:06.009358 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. May 26 17:01:06.010703 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:06.012105 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-69621d1a-62eb-4fcf-b012-ccfc73440bf1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Returning 404 to user: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:01:06.012105 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-69621d1a-62eb-4fcf-b012-ccfc73440bf1 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 404 len: 111 microversion: 2.1 time: 0.031060 May 26 17:01:06.012105 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 468/942] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:05 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:01:06.018917 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8feaff7c-3457-4894-bfa9-a8daaac61c0d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '.version_select at 0x7fbe8037b700>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:06.093805 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8feaff7c-3457-4894-bfa9-a8daaac61c0d tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-88562116" status: 202 len: 0 microversion: 2.1 time: 0.079448 May 26 17:01:06.094488 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 475/943] 10.222.0.48 () {58 vars in 1214 bytes} [Thu May 26 17:01:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-88562116 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:01:06.240356 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-10a34da1-4788-4b3d-8699-68285931e842 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:06.240978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-10a34da1-4788-4b3d-8699-68285931e842 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:06.247011 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-10a34da1-4788-4b3d-8699-68285931e842 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:06.247469 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-10a34da1-4788-4b3d-8699-68285931e842 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:06.248238 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-10a34da1-4788-4b3d-8699-68285931e842 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:06.248757 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-10a34da1-4788-4b3d-8699-68285931e842 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:06.405221 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-10a34da1-4788-4b3d-8699-68285931e842 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:06.414632 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-10a34da1-4788-4b3d-8699-68285931e842 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:06.416717 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-10a34da1-4788-4b3d-8699-68285931e842 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:06.418172 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-10a34da1-4788-4b3d-8699-68285931e842 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1729 microversion: 2.20 time: 0.181844 May 26 17:01:06.429213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 469/944] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:01:06 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:01:07.436659 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-bb968d36-64ac-4feb-bec7-555472e2bdf0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:07.437188 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-bb968d36-64ac-4feb-bec7-555472e2bdf0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:07.444436 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bb968d36-64ac-4feb-bec7-555472e2bdf0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:07.444890 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bb968d36-64ac-4feb-bec7-555472e2bdf0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:07.445683 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bb968d36-64ac-4feb-bec7-555472e2bdf0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:07.446120 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bb968d36-64ac-4feb-bec7-555472e2bdf0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:07.578272 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-bb968d36-64ac-4feb-bec7-555472e2bdf0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:07.586262 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-bb968d36-64ac-4feb-bec7-555472e2bdf0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:07.587819 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-bb968d36-64ac-4feb-bec7-555472e2bdf0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:07.588978 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-bb968d36-64ac-4feb-bec7-555472e2bdf0 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1716 microversion: 2.20 time: 0.156947 May 26 17:01:07.589557 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 476/945] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:01:07 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:01:09.451620 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-752107fc-591e-4f21-8d51-0f7abacbef62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:09.452150 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-752107fc-591e-4f21-8d51-0f7abacbef62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:09.458745 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-752107fc-591e-4f21-8d51-0f7abacbef62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:09.459203 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-752107fc-591e-4f21-8d51-0f7abacbef62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:09.459974 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-752107fc-591e-4f21-8d51-0f7abacbef62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:09.460421 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-752107fc-591e-4f21-8d51-0f7abacbef62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:09.474124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-752107fc-591e-4f21-8d51-0f7abacbef62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] HTTP exception thrown: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-752107fc-591e-4f21-8d51-0f7abacbef62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Request method failure captured: May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 HTTP/1.1 May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7CM4fldsHDPgaRLTByjN4M_RTZa9UrovvQY7c9sUtwKdbMkDUvbFos_HFvNUmjAZIlQj0sT963_vZ0gwTkb1eub2bQ8hyZzwwP6YAfWsit3x-0xEiocaTtHPSAbAE4k9J_x81wGbCNE5wvKAy4HUwwmLGer77t-ZBE04EYNVOHozzc May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 89a7299f01984027a505aa43d96e07b3 May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeTestJSON-378673516 May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:01:09.475957 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:01:09.477700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89a7299f01984027a505aa43d96e07b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89a7299f01984027a505aa43d96e07b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_89a7299f01984027a505aa43d96e07b3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/89a7299f01984027a505aa43d96e07b3"}]}] May 26 17:01:09.477700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeTestJSON-378673516 May 26 17:01:09.477700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 89a7299f01984027a505aa43d96e07b3 May 26 17:01:09.477700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeTestJSON-378673516 May 26 17:01:09.477700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeTestJSON-378673516-project May 26 17:01:09.477700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:01:09.477700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:01:09.477700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: d5684eb0dd3141f5a25b61aafedbe865 May 26 17:01:09.477700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeTestJSON-378673516-project May 26 17:01:09.477700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 17:01:09.477700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. May 26 17:01:09.477700 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': '8c09b3b4-c5ad-40d6-a92e-66fccb618e11'} May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:01:09.478638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. May 26 17:01:09.480340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:09.481943 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-752107fc-591e-4f21-8d51-0f7abacbef62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Returning 404 to user: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:01:09.481943 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-752107fc-591e-4f21-8d51-0f7abacbef62 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 404 len: 111 microversion: 2.1 time: 0.029755 May 26 17:01:09.481943 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 470/946] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:01:09 2022] DELETE /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:01:09.486650 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a56a0950-460f-49cc-b42e-95ecba80e259 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:09.487257 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a56a0950-460f-49cc-b42e-95ecba80e259 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: 8c09b3b4-c5ad-40d6-a92e-66fccb618e11] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:09.493815 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a56a0950-460f-49cc-b42e-95ecba80e259 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:09.494259 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a56a0950-460f-49cc-b42e-95ecba80e259 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:09.495008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a56a0950-460f-49cc-b42e-95ecba80e259 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:09.495437 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a56a0950-460f-49cc-b42e-95ecba80e259 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:09.509603 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-a56a0950-460f-49cc-b42e-95ecba80e259 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] HTTP exception thrown: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a56a0950-460f-49cc-b42e-95ecba80e259 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Request method failure captured: May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 HTTP/1.1 May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7CM4fldsHDPgaRLTByjN4M_RTZa9UrovvQY7c9sUtwKdbMkDUvbFos_HFvNUmjAZIlQj0sT963_vZ0gwTkb1eub2bQ8hyZzwwP6YAfWsit3x-0xEiocaTtHPSAbAE4k9J_x81wGbCNE5wvKAy4HUwwmLGer77t-ZBE04EYNVOHozzc May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 89a7299f01984027a505aa43d96e07b3 May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeTestJSON-378673516 May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:01:09.511240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:01:09.512737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89a7299f01984027a505aa43d96e07b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89a7299f01984027a505aa43d96e07b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_89a7299f01984027a505aa43d96e07b3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/89a7299f01984027a505aa43d96e07b3"}]}] May 26 17:01:09.512737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeTestJSON-378673516 May 26 17:01:09.512737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 89a7299f01984027a505aa43d96e07b3 May 26 17:01:09.512737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeTestJSON-378673516 May 26 17:01:09.512737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeTestJSON-378673516-project May 26 17:01:09.512737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:01:09.512737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:01:09.512737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: d5684eb0dd3141f5a25b61aafedbe865 May 26 17:01:09.512737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeTestJSON-378673516-project May 26 17:01:09.512737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:01:09.512737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. May 26 17:01:09.512737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '8c09b3b4-c5ad-40d6-a92e-66fccb618e11'} May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:01:09.513639 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. May 26 17:01:09.515088 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:09.516381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a56a0950-460f-49cc-b42e-95ecba80e259 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Returning 404 to user: Instance 8c09b3b4-c5ad-40d6-a92e-66fccb618e11 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:01:09.516381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a56a0950-460f-49cc-b42e-95ecba80e259 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11" status: 404 len: 111 microversion: 2.1 time: 0.030270 May 26 17:01:09.516381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 477/947] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:09 2022] GET /compute/v2.1/servers/8c09b3b4-c5ad-40d6-a92e-66fccb618e11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:01:10.774540 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d61a8e11-faa2-4b70-9634-59e832c51280 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:10.776010 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d61a8e11-faa2-4b70-9634-59e832c51280 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:10.781668 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d61a8e11-faa2-4b70-9634-59e832c51280 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:10.782118 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d61a8e11-faa2-4b70-9634-59e832c51280 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:10.782879 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d61a8e11-faa2-4b70-9634-59e832c51280 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:10.783319 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d61a8e11-faa2-4b70-9634-59e832c51280 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:10.797163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-d61a8e11-faa2-4b70-9634-59e832c51280 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] HTTP exception thrown: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d61a8e11-faa2-4b70-9634-59e832c51280 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Request method failure captured: May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 HTTP/1.1 May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7CM4fldsHDPgaRLTByjN4M_RTZa9UrovvQY7c9sUtwKdbMkDUvbFos_HFvNUmjAZIlQj0sT963_vZ0gwTkb1eub2bQ8hyZzwwP6YAfWsit3x-0xEiocaTtHPSAbAE4k9J_x81wGbCNE5wvKAy4HUwwmLGer77t-ZBE04EYNVOHozzc May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 89a7299f01984027a505aa43d96e07b3 May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeTestJSON-378673516 May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:01:10.801538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:01:10.803140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89a7299f01984027a505aa43d96e07b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89a7299f01984027a505aa43d96e07b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_89a7299f01984027a505aa43d96e07b3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/89a7299f01984027a505aa43d96e07b3"}]}] May 26 17:01:10.803140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeTestJSON-378673516 May 26 17:01:10.803140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 89a7299f01984027a505aa43d96e07b3 May 26 17:01:10.803140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeTestJSON-378673516 May 26 17:01:10.803140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeTestJSON-378673516-project May 26 17:01:10.803140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:01:10.803140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:01:10.803140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: d5684eb0dd3141f5a25b61aafedbe865 May 26 17:01:10.803140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeTestJSON-378673516-project May 26 17:01:10.803140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 17:01:10.803140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. May 26 17:01:10.803140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': 'e432ca18-47de-4981-bc37-036d927a5c62'} May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:01:10.804124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. May 26 17:01:10.805555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:10.806791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d61a8e11-faa2-4b70-9634-59e832c51280 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Returning 404 to user: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:01:10.806791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d61a8e11-faa2-4b70-9634-59e832c51280 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 404 len: 111 microversion: 2.1 time: 0.029555 May 26 17:01:10.806791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 471/948] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:01:10 2022] DELETE /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:01:10.808537 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-439235c3-6638-49fe-a418-1d5615a4c435 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:10.809160 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-439235c3-6638-49fe-a418-1d5615a4c435 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] [instance: e432ca18-47de-4981-bc37-036d927a5c62] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:10.816594 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-439235c3-6638-49fe-a418-1d5615a4c435 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:10.817056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-439235c3-6638-49fe-a418-1d5615a4c435 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:10.817881 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-439235c3-6638-49fe-a418-1d5615a4c435 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:10.818328 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-439235c3-6638-49fe-a418-1d5615a4c435 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:10.833188 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-439235c3-6638-49fe-a418-1d5615a4c435 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] HTTP exception thrown: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-439235c3-6638-49fe-a418-1d5615a4c435 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Request method failure captured: May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 HTTP/1.1 May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7CM4fldsHDPgaRLTByjN4M_RTZa9UrovvQY7c9sUtwKdbMkDUvbFos_HFvNUmjAZIlQj0sT963_vZ0gwTkb1eub2bQ8hyZzwwP6YAfWsit3x-0xEiocaTtHPSAbAE4k9J_x81wGbCNE5wvKAy4HUwwmLGer77t-ZBE04EYNVOHozzc May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 89a7299f01984027a505aa43d96e07b3 May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeTestJSON-378673516 May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:01:10.834822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:01:10.836396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89a7299f01984027a505aa43d96e07b3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/89a7299f01984027a505aa43d96e07b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_89a7299f01984027a505aa43d96e07b3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/89a7299f01984027a505aa43d96e07b3"}]}] May 26 17:01:10.836396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeTestJSON-378673516 May 26 17:01:10.836396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 89a7299f01984027a505aa43d96e07b3 May 26 17:01:10.836396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeTestJSON-378673516 May 26 17:01:10.836396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeTestJSON-378673516-project May 26 17:01:10.836396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:01:10.836396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:01:10.836396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: d5684eb0dd3141f5a25b61aafedbe865 May 26 17:01:10.836396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeTestJSON-378673516-project May 26 17:01:10.836396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:01:10.836396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. May 26 17:01:10.836396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': 'e432ca18-47de-4981-bc37-036d927a5c62'} May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:01:10.838020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. May 26 17:01:10.839442 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:10.840761 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-439235c3-6638-49fe-a418-1d5615a4c435 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] Returning 404 to user: Instance e432ca18-47de-4981-bc37-036d927a5c62 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:01:10.840761 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-439235c3-6638-49fe-a418-1d5615a4c435 tempest-AttachVolumeTestJSON-378673516 tempest-AttachVolumeTestJSON-378673516-project] 10.222.0.48 "GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62" status: 404 len: 111 microversion: 2.1 time: 0.031489 May 26 17:01:10.840761 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 478/949] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:10 2022] GET /compute/v2.1/servers/e432ca18-47de-4981-bc37-036d927a5c62 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:01:13.095227 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-eb25c419-aa7c-42bc-b259-4c2752d1332f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:13.096035 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-eb25c419-aa7c-42bc-b259-4c2752d1332f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:13.103177 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-eb25c419-aa7c-42bc-b259-4c2752d1332f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:13.103912 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-eb25c419-aa7c-42bc-b259-4c2752d1332f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:13.104896 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-eb25c419-aa7c-42bc-b259-4c2752d1332f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:13.105537 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-eb25c419-aa7c-42bc-b259-4c2752d1332f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:13.129343 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-eb25c419-aa7c-42bc-b259-4c2752d1332f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/ips" status: 200 len: 151 microversion: 2.1 time: 0.038624 May 26 17:01:13.129924 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 472/950] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 26 17:01:13 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:14.768017 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-393ab2ac-3df7-4941-8359-0a3dc0bfe318 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50c688d4-bc77-4f99-9548-af4086de06ed"}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:14.769089 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-393ab2ac-3df7-4941-8359-0a3dc0bfe318 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:14.775786 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-393ab2ac-3df7-4941-8359-0a3dc0bfe318 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:14.776190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-393ab2ac-3df7-4941-8359-0a3dc0bfe318 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:14.776961 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-393ab2ac-3df7-4941-8359-0a3dc0bfe318 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:14.777444 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-393ab2ac-3df7-4941-8359-0a3dc0bfe318 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:15.587395 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-393ab2ac-3df7-4941-8359-0a3dc0bfe318 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "POST /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.823966 May 26 17:01:15.588124 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 479/951] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 26 17:01:14 2022] POST /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments => generated 194 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:20.200882 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9f468548-7084-4f16-b09e-5c40b9c407e3 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d89415c-302c-4a84-ab98-502c611cec77", "device": "/dev/sdb"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:20.202829 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9f468548-7084-4f16-b09e-5c40b9c407e3 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:20.205161 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:20.210099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f468548-7084-4f16-b09e-5c40b9c407e3 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:20.210556 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f468548-7084-4f16-b09e-5c40b9c407e3 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:20.211334 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f468548-7084-4f16-b09e-5c40b9c407e3 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:20.211779 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9f468548-7084-4f16-b09e-5c40b9c407e3 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:21.124752 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9f468548-7084-4f16-b09e-5c40b9c407e3 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "POST /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.927737 May 26 17:01:21.125371 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 473/952] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 26 17:01:20 2022] POST /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9/os-volume_attachments => generated 194 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:24.636394 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8ba4f3f5-e436-4ce4-9e1f-cb77d0dff9a3 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:24.637039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8ba4f3f5-e436-4ce4-9e1f-cb77d0dff9a3 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:24.639778 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:24.645013 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ba4f3f5-e436-4ce4-9e1f-cb77d0dff9a3 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:24.648964 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ba4f3f5-e436-4ce4-9e1f-cb77d0dff9a3 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:24.648964 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ba4f3f5-e436-4ce4-9e1f-cb77d0dff9a3 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:24.648964 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ba4f3f5-e436-4ce4-9e1f-cb77d0dff9a3 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:24.670762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-8ba4f3f5-e436-4ce4-9e1f-cb77d0dff9a3 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lazy-loading 'flavor' on Instance uuid b981b012-8995-4185-9b5c-03934263a18c {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:01:24.864087 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5672595e-8c44-4b44-a342-36ea7f2b0df2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:24.864724 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5672595e-8c44-4b44-a342-36ea7f2b0df2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:24.871005 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5672595e-8c44-4b44-a342-36ea7f2b0df2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:24.871458 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5672595e-8c44-4b44-a342-36ea7f2b0df2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:24.872738 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5672595e-8c44-4b44-a342-36ea7f2b0df2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:24.872738 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5672595e-8c44-4b44-a342-36ea7f2b0df2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:24.955687 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-5672595e-8c44-4b44-a342-36ea7f2b0df2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lazy-loading 'services' on Instance uuid 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:01:25.113298 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8ba4f3f5-e436-4ce4-9e1f-cb77d0dff9a3 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "POST /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c/action" status: 202 len: 0 microversion: 2.1 time: 0.481340 May 26 17:01:25.115631 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 480/953] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 26 17:01:24 2022] POST /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:01:25.126855 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5130b6c2-a400-4538-ba64-117b1891b0ff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:25.127595 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5130b6c2-a400-4538-ba64-117b1891b0ff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:25.133737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5130b6c2-a400-4538-ba64-117b1891b0ff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:25.134219 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5130b6c2-a400-4538-ba64-117b1891b0ff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:25.134989 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5130b6c2-a400-4538-ba64-117b1891b0ff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:25.135480 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5130b6c2-a400-4538-ba64-117b1891b0ff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:25.262128 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5672595e-8c44-4b44-a342-36ea7f2b0df2 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "DELETE /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments/50c688d4-bc77-4f99-9548-af4086de06ed" status: 202 len: 0 microversion: 2.1 time: 0.402703 May 26 17:01:25.262878 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 474/954] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 26 17:01:24 2022] DELETE /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments/50c688d4-bc77-4f99-9548-af4086de06ed => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:01:25.277043 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5130b6c2-a400-4538-ba64-117b1891b0ff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:25.277284 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c4eb6da0-f644-4e25-8684-d69d9d3fc37f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:25.283393 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c4eb6da0-f644-4e25-8684-d69d9d3fc37f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:25.286910 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5130b6c2-a400-4538-ba64-117b1891b0ff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.168158 May 26 17:01:25.304654 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 481/955] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:25 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:25.304776 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c4eb6da0-f644-4e25-8684-d69d9d3fc37f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:25.304776 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c4eb6da0-f644-4e25-8684-d69d9d3fc37f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:25.304776 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c4eb6da0-f644-4e25-8684-d69d9d3fc37f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:25.304776 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c4eb6da0-f644-4e25-8684-d69d9d3fc37f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:25.324978 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c4eb6da0-f644-4e25-8684-d69d9d3fc37f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057187 May 26 17:01:25.325623 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 475/956] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 17:01:25 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:01:26.313063 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-dadb6407-ce11-45bb-90c0-e868efb397be tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:26.314255 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-dadb6407-ce11-45bb-90c0-e868efb397be tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:26.321739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dadb6407-ce11-45bb-90c0-e868efb397be tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:26.322184 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dadb6407-ce11-45bb-90c0-e868efb397be tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:26.322996 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dadb6407-ce11-45bb-90c0-e868efb397be tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:26.323369 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dadb6407-ce11-45bb-90c0-e868efb397be tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:26.337538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b0724dd2-40f9-4a38-b5b3-ff7f3f616b96 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:26.339227 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b0724dd2-40f9-4a38-b5b3-ff7f3f616b96 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:26.346222 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0724dd2-40f9-4a38-b5b3-ff7f3f616b96 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:26.346674 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0724dd2-40f9-4a38-b5b3-ff7f3f616b96 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:26.347446 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0724dd2-40f9-4a38-b5b3-ff7f3f616b96 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:26.347883 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b0724dd2-40f9-4a38-b5b3-ff7f3f616b96 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:26.387257 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b0724dd2-40f9-4a38-b5b3-ff7f3f616b96 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053702 May 26 17:01:26.388117 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 476/957] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 17:01:26 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:01:26.479517 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-dadb6407-ce11-45bb-90c0-e868efb397be tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:26.488214 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-dadb6407-ce11-45bb-90c0-e868efb397be tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.179981 May 26 17:01:26.488946 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 482/958] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:26 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:27.398895 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cf57a94d-895b-4581-8647-3b0ca17474da tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:27.400182 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-cf57a94d-895b-4581-8647-3b0ca17474da tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:27.407537 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cf57a94d-895b-4581-8647-3b0ca17474da tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:27.408005 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cf57a94d-895b-4581-8647-3b0ca17474da tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:27.408798 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cf57a94d-895b-4581-8647-3b0ca17474da tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:27.409230 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-cf57a94d-895b-4581-8647-3b0ca17474da tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:27.438696 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cf57a94d-895b-4581-8647-3b0ca17474da tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044137 May 26 17:01:27.439252 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 477/959] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 17:01:27 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:01:27.513182 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-fff516b4-344b-4849-ad5a-c8aea7551f91 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:27.514358 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-fff516b4-344b-4849-ad5a-c8aea7551f91 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:27.521095 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fff516b4-344b-4849-ad5a-c8aea7551f91 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:27.521581 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fff516b4-344b-4849-ad5a-c8aea7551f91 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:27.522348 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fff516b4-344b-4849-ad5a-c8aea7551f91 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:27.522941 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-fff516b4-344b-4849-ad5a-c8aea7551f91 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:27.661655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-fff516b4-344b-4849-ad5a-c8aea7551f91 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:27.669729 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-fff516b4-344b-4849-ad5a-c8aea7551f91 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.160519 May 26 17:01:27.670317 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 483/960] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:27 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:28.451877 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d044ee43-70ad-49f8-a884-f21e72ae5a76 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:28.452810 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d044ee43-70ad-49f8-a884-f21e72ae5a76 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:28.462452 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d044ee43-70ad-49f8-a884-f21e72ae5a76 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:28.462914 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d044ee43-70ad-49f8-a884-f21e72ae5a76 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:28.463752 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d044ee43-70ad-49f8-a884-f21e72ae5a76 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:28.464192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d044ee43-70ad-49f8-a884-f21e72ae5a76 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:28.497065 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d044ee43-70ad-49f8-a884-f21e72ae5a76 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049939 May 26 17:01:28.497781 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 478/961] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 17:01:28 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:28.690991 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8135eae2-47a7-4fcf-aa84-737ba31e616b tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:28.692567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8135eae2-47a7-4fcf-aa84-737ba31e616b tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:28.702737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8135eae2-47a7-4fcf-aa84-737ba31e616b tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:28.703449 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8135eae2-47a7-4fcf-aa84-737ba31e616b tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:28.704358 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8135eae2-47a7-4fcf-aa84-737ba31e616b tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:28.705503 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8135eae2-47a7-4fcf-aa84-737ba31e616b tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:28.915644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8135eae2-47a7-4fcf-aa84-737ba31e616b tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:28.923520 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8135eae2-47a7-4fcf-aa84-737ba31e616b tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.237504 May 26 17:01:28.924087 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 484/962] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:28 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:29.508401 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5f5b695b-97c7-4f7a-8115-a0040fd4c1dd tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:29.509486 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5f5b695b-97c7-4f7a-8115-a0040fd4c1dd tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:29.516291 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5f5b695b-97c7-4f7a-8115-a0040fd4c1dd tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:29.516682 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5f5b695b-97c7-4f7a-8115-a0040fd4c1dd tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:29.517479 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5f5b695b-97c7-4f7a-8115-a0040fd4c1dd tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:29.517928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5f5b695b-97c7-4f7a-8115-a0040fd4c1dd tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:29.539044 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:29.554033 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5f5b695b-97c7-4f7a-8115-a0040fd4c1dd tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049750 May 26 17:01:29.554596 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 479/963] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 17:01:29 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:29.940163 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-381415c6-258e-492f-856f-6a54e8a1a2da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:29.940821 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-381415c6-258e-492f-856f-6a54e8a1a2da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:29.947427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-381415c6-258e-492f-856f-6a54e8a1a2da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:29.949593 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-381415c6-258e-492f-856f-6a54e8a1a2da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:29.949593 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-381415c6-258e-492f-856f-6a54e8a1a2da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:29.949593 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-381415c6-258e-492f-856f-6a54e8a1a2da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:30.135623 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-381415c6-258e-492f-856f-6a54e8a1a2da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:30.146020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-381415c6-258e-492f-856f-6a54e8a1a2da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.209717 May 26 17:01:30.146641 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 485/964] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:29 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:30.565752 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-941eb5a3-36dc-4af7-a103-e6c88adc59f7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:30.566687 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-941eb5a3-36dc-4af7-a103-e6c88adc59f7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:30.574201 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-941eb5a3-36dc-4af7-a103-e6c88adc59f7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:30.574660 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-941eb5a3-36dc-4af7-a103-e6c88adc59f7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:30.575434 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-941eb5a3-36dc-4af7-a103-e6c88adc59f7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:30.575873 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-941eb5a3-36dc-4af7-a103-e6c88adc59f7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:30.608896 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-941eb5a3-36dc-4af7-a103-e6c88adc59f7 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047169 May 26 17:01:30.609500 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 480/965] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 17:01:30 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:31.164883 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-28321c23-09d1-4230-92a8-b5707de8ef5f tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:31.165602 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-28321c23-09d1-4230-92a8-b5707de8ef5f tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:31.172703 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-28321c23-09d1-4230-92a8-b5707de8ef5f tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:31.173643 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-28321c23-09d1-4230-92a8-b5707de8ef5f tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:31.174022 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-28321c23-09d1-4230-92a8-b5707de8ef5f tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:31.174508 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-28321c23-09d1-4230-92a8-b5707de8ef5f tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:31.314110 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-28321c23-09d1-4230-92a8-b5707de8ef5f tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:31.321866 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-28321c23-09d1-4230-92a8-b5707de8ef5f tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.160815 May 26 17:01:31.322435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 486/966] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:31 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:31.620431 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-caefae02-d70e-4725-92de-6402adb3af8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:31.621535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-caefae02-d70e-4725-92de-6402adb3af8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:31.628682 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-caefae02-d70e-4725-92de-6402adb3af8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:31.637872 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-caefae02-d70e-4725-92de-6402adb3af8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:31.637872 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-caefae02-d70e-4725-92de-6402adb3af8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:31.637872 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-caefae02-d70e-4725-92de-6402adb3af8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:31.659686 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-caefae02-d70e-4725-92de-6402adb3af8c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043352 May 26 17:01:31.660242 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 481/967] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 17:01:31 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:32.338940 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f15c3911-1834-43c7-b395-bdc611f59cff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:32.339585 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f15c3911-1834-43c7-b395-bdc611f59cff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:32.346368 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f15c3911-1834-43c7-b395-bdc611f59cff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:32.346829 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f15c3911-1834-43c7-b395-bdc611f59cff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:32.347599 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f15c3911-1834-43c7-b395-bdc611f59cff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:32.348048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f15c3911-1834-43c7-b395-bdc611f59cff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:32.499314 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f15c3911-1834-43c7-b395-bdc611f59cff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:32.508262 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f15c3911-1834-43c7-b395-bdc611f59cff tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.173142 May 26 17:01:32.508952 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 487/968] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:32 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:32.672241 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6a171537-ee11-4973-8331-4baa409e153e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:32.673361 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6a171537-ee11-4973-8331-4baa409e153e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:32.680333 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6a171537-ee11-4973-8331-4baa409e153e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:32.680794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6a171537-ee11-4973-8331-4baa409e153e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:32.681598 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6a171537-ee11-4973-8331-4baa409e153e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:32.682040 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6a171537-ee11-4973-8331-4baa409e153e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:32.712593 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6a171537-ee11-4973-8331-4baa409e153e tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045230 May 26 17:01:32.713510 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 482/969] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 17:01:32 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 17:01:32.773548 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-624425b7-6538-4001-bd14-f2cf5bb54f12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:32.774102 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-624425b7-6538-4001-bd14-f2cf5bb54f12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:32.780398 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-624425b7-6538-4001-bd14-f2cf5bb54f12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:32.780907 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-624425b7-6538-4001-bd14-f2cf5bb54f12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:32.782053 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-624425b7-6538-4001-bd14-f2cf5bb54f12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:32.782500 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-624425b7-6538-4001-bd14-f2cf5bb54f12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:32.787167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:32.811509 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-624425b7-6538-4001-bd14-f2cf5bb54f12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Going to try to terminate instance {{(pid=124836) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:01:33.173095 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-624425b7-6538-4001-bd14-f2cf5bb54f12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "DELETE /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 204 len: 0 microversion: 2.1 time: 0.403232 May 26 17:01:33.173717 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 488/970] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:01:32 2022] DELETE /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:01:33.182001 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-66e23a01-8689-46cd-8835-e2bd9af58e38 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:33.182735 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-66e23a01-8689-46cd-8835-e2bd9af58e38 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:33.189578 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-66e23a01-8689-46cd-8835-e2bd9af58e38 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:33.190120 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-66e23a01-8689-46cd-8835-e2bd9af58e38 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:33.190896 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-66e23a01-8689-46cd-8835-e2bd9af58e38 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:33.191353 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-66e23a01-8689-46cd-8835-e2bd9af58e38 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:33.379352 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-66e23a01-8689-46cd-8835-e2bd9af58e38 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:33.388451 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-66e23a01-8689-46cd-8835-e2bd9af58e38 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1683 microversion: 2.1 time: 0.210392 May 26 17:01:33.389368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 483/971] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:33 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1683 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:33.526482 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f9e89a3b-fab1-41a2-a10b-e244b1e41dba tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:33.528475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f9e89a3b-fab1-41a2-a10b-e244b1e41dba tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:33.535585 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f9e89a3b-fab1-41a2-a10b-e244b1e41dba tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:33.536027 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f9e89a3b-fab1-41a2-a10b-e244b1e41dba tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:33.536805 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f9e89a3b-fab1-41a2-a10b-e244b1e41dba tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:33.537248 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f9e89a3b-fab1-41a2-a10b-e244b1e41dba tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:33.674347 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f9e89a3b-fab1-41a2-a10b-e244b1e41dba tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:33.681586 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f9e89a3b-fab1-41a2-a10b-e244b1e41dba tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.159647 May 26 17:01:33.682165 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 489/972] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:33 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:34.410552 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0215936e-22b8-4d24-8853-b5335092bf68 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:34.411766 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0215936e-22b8-4d24-8853-b5335092bf68 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:34.424248 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0215936e-22b8-4d24-8853-b5335092bf68 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:34.425155 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0215936e-22b8-4d24-8853-b5335092bf68 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:34.426555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0215936e-22b8-4d24-8853-b5335092bf68 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:34.427359 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0215936e-22b8-4d24-8853-b5335092bf68 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:34.598733 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0215936e-22b8-4d24-8853-b5335092bf68 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:34.606731 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0215936e-22b8-4d24-8853-b5335092bf68 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1683 microversion: 2.1 time: 0.204229 May 26 17:01:34.608008 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 484/973] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:34 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1683 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:34.698744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3b1f631e-1622-40fc-b3da-57ee0d0a6afe tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:34.699373 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3b1f631e-1622-40fc-b3da-57ee0d0a6afe tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:34.705936 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3b1f631e-1622-40fc-b3da-57ee0d0a6afe tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:34.706418 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3b1f631e-1622-40fc-b3da-57ee0d0a6afe tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:34.707392 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3b1f631e-1622-40fc-b3da-57ee0d0a6afe tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:34.707840 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3b1f631e-1622-40fc-b3da-57ee0d0a6afe tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:34.841117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3b1f631e-1622-40fc-b3da-57ee0d0a6afe tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:34.849921 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3b1f631e-1622-40fc-b3da-57ee0d0a6afe tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.154846 May 26 17:01:34.850490 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 490/974] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:34 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:35.624637 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e444a215-563c-4c90-badf-e0d9836bd202 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:35.625304 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e444a215-563c-4c90-badf-e0d9836bd202 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:35.632154 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e444a215-563c-4c90-badf-e0d9836bd202 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:35.632606 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e444a215-563c-4c90-badf-e0d9836bd202 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:35.633407 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e444a215-563c-4c90-badf-e0d9836bd202 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:35.633850 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e444a215-563c-4c90-badf-e0d9836bd202 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:35.771606 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e444a215-563c-4c90-badf-e0d9836bd202 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:35.779723 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e444a215-563c-4c90-badf-e0d9836bd202 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1683 microversion: 2.1 time: 0.159651 May 26 17:01:35.780513 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 485/975] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:35 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:35.868025 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7a8f4258-29e5-43d6-aad4-91dc610e7a81 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:35.868655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7a8f4258-29e5-43d6-aad4-91dc610e7a81 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:35.875447 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7a8f4258-29e5-43d6-aad4-91dc610e7a81 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:35.875890 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7a8f4258-29e5-43d6-aad4-91dc610e7a81 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:35.876646 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7a8f4258-29e5-43d6-aad4-91dc610e7a81 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:35.877083 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7a8f4258-29e5-43d6-aad4-91dc610e7a81 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:36.009433 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7a8f4258-29e5-43d6-aad4-91dc610e7a81 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:36.017372 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7a8f4258-29e5-43d6-aad4-91dc610e7a81 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.153150 May 26 17:01:36.017953 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 491/976] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:35 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:36.798753 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-30e213b9-20aa-460b-8590-22a05b75d04a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:36.799306 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-30e213b9-20aa-460b-8590-22a05b75d04a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:36.805528 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-30e213b9-20aa-460b-8590-22a05b75d04a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:36.805987 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-30e213b9-20aa-460b-8590-22a05b75d04a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:36.806769 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-30e213b9-20aa-460b-8590-22a05b75d04a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:36.807222 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-30e213b9-20aa-460b-8590-22a05b75d04a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:36.948133 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-30e213b9-20aa-460b-8590-22a05b75d04a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:36.957621 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-30e213b9-20aa-460b-8590-22a05b75d04a tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1683 microversion: 2.1 time: 0.162733 May 26 17:01:36.958865 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 486/977] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:36 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:37.034638 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7a68fcb5-61af-4968-8ad6-9a627b36bec4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:37.035266 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7a68fcb5-61af-4968-8ad6-9a627b36bec4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:37.041865 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7a68fcb5-61af-4968-8ad6-9a627b36bec4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:37.042245 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7a68fcb5-61af-4968-8ad6-9a627b36bec4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:37.043023 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7a68fcb5-61af-4968-8ad6-9a627b36bec4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:37.043464 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7a68fcb5-61af-4968-8ad6-9a627b36bec4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:37.190852 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7a68fcb5-61af-4968-8ad6-9a627b36bec4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:37.198568 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7a68fcb5-61af-4968-8ad6-9a627b36bec4 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.168324 May 26 17:01:37.199121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 492/978] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:37 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:37.975952 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e2962823-1c78-493f-be56-02732e54bde1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:37.976563 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e2962823-1c78-493f-be56-02732e54bde1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:37.983619 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2962823-1c78-493f-be56-02732e54bde1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:37.985320 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2962823-1c78-493f-be56-02732e54bde1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:37.985320 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2962823-1c78-493f-be56-02732e54bde1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:37.985320 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-e2962823-1c78-493f-be56-02732e54bde1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:38.122627 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e2962823-1c78-493f-be56-02732e54bde1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:38.130772 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e2962823-1c78-493f-be56-02732e54bde1 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1683 microversion: 2.1 time: 0.158916 May 26 17:01:38.131359 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 487/979] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:37 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:38.215934 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3451c7fe-089d-47ff-9e54-f6f27ea21412 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:38.216545 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3451c7fe-089d-47ff-9e54-f6f27ea21412 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:38.223702 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3451c7fe-089d-47ff-9e54-f6f27ea21412 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:38.224154 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3451c7fe-089d-47ff-9e54-f6f27ea21412 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:38.225188 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3451c7fe-089d-47ff-9e54-f6f27ea21412 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:38.225655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3451c7fe-089d-47ff-9e54-f6f27ea21412 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:38.356737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3451c7fe-089d-47ff-9e54-f6f27ea21412 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:38.364643 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3451c7fe-089d-47ff-9e54-f6f27ea21412 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.152744 May 26 17:01:38.365219 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 493/980] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:38 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:39.156098 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-79526a6b-985e-4aaf-b6f2-ee91c02fec12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:39.156726 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-79526a6b-985e-4aaf-b6f2-ee91c02fec12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:39.163387 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79526a6b-985e-4aaf-b6f2-ee91c02fec12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:39.163842 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79526a6b-985e-4aaf-b6f2-ee91c02fec12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:39.164616 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79526a6b-985e-4aaf-b6f2-ee91c02fec12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:39.165054 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-79526a6b-985e-4aaf-b6f2-ee91c02fec12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:39.292821 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-79526a6b-985e-4aaf-b6f2-ee91c02fec12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:39.300551 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-79526a6b-985e-4aaf-b6f2-ee91c02fec12 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1683 microversion: 2.1 time: 0.148903 May 26 17:01:39.301126 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 488/981] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:39 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:39.382708 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a0b9b54a-0eba-4826-a27f-d96703b090e1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:39.383246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a0b9b54a-0eba-4826-a27f-d96703b090e1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:39.390477 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a0b9b54a-0eba-4826-a27f-d96703b090e1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:39.390929 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a0b9b54a-0eba-4826-a27f-d96703b090e1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:39.391695 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a0b9b54a-0eba-4826-a27f-d96703b090e1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:39.392146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a0b9b54a-0eba-4826-a27f-d96703b090e1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:39.527378 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a0b9b54a-0eba-4826-a27f-d96703b090e1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:39.535753 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a0b9b54a-0eba-4826-a27f-d96703b090e1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.156966 May 26 17:01:39.536323 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 494/982] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:39 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:40.317379 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ff2c2371-59b4-4909-9df2-033fae639b77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:40.317998 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ff2c2371-59b4-4909-9df2-033fae639b77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:40.324560 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ff2c2371-59b4-4909-9df2-033fae639b77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:40.324938 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ff2c2371-59b4-4909-9df2-033fae639b77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:40.325718 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ff2c2371-59b4-4909-9df2-033fae639b77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:40.326161 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ff2c2371-59b4-4909-9df2-033fae639b77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:40.454666 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ff2c2371-59b4-4909-9df2-033fae639b77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:40.462352 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ff2c2371-59b4-4909-9df2-033fae639b77 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1683 microversion: 2.1 time: 0.148907 May 26 17:01:40.462912 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 489/983] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:40 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:40.552740 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-95cc2267-6335-4cc5-ad88-e04c924dfcf9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:40.553379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-95cc2267-6335-4cc5-ad88-e04c924dfcf9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:40.560044 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-95cc2267-6335-4cc5-ad88-e04c924dfcf9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:40.560492 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-95cc2267-6335-4cc5-ad88-e04c924dfcf9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:40.561249 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-95cc2267-6335-4cc5-ad88-e04c924dfcf9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:40.561718 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-95cc2267-6335-4cc5-ad88-e04c924dfcf9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:40.703228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-95cc2267-6335-4cc5-ad88-e04c924dfcf9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:40.711129 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-95cc2267-6335-4cc5-ad88-e04c924dfcf9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.162141 May 26 17:01:40.711794 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 495/984] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:40 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:41.478885 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d2a7c10a-a481-46f3-b7e7-4ad528c39d8d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:41.479634 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d2a7c10a-a481-46f3-b7e7-4ad528c39d8d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:41.487220 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2a7c10a-a481-46f3-b7e7-4ad528c39d8d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:41.487681 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2a7c10a-a481-46f3-b7e7-4ad528c39d8d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:41.488470 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2a7c10a-a481-46f3-b7e7-4ad528c39d8d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:41.489103 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d2a7c10a-a481-46f3-b7e7-4ad528c39d8d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:41.639535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d2a7c10a-a481-46f3-b7e7-4ad528c39d8d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:41.647778 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d2a7c10a-a481-46f3-b7e7-4ad528c39d8d tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1683 microversion: 2.1 time: 0.173184 May 26 17:01:41.648460 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 490/985] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:41 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1683 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:41.733645 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ddd586af-54ad-4e54-a224-b7322e3afd18 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:41.734649 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ddd586af-54ad-4e54-a224-b7322e3afd18 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:41.745078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ddd586af-54ad-4e54-a224-b7322e3afd18 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:41.745674 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ddd586af-54ad-4e54-a224-b7322e3afd18 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:41.746568 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ddd586af-54ad-4e54-a224-b7322e3afd18 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:41.747175 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ddd586af-54ad-4e54-a224-b7322e3afd18 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:41.890032 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ddd586af-54ad-4e54-a224-b7322e3afd18 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:41.898490 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ddd586af-54ad-4e54-a224-b7322e3afd18 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.172928 May 26 17:01:41.899064 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 496/986] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:41 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:42.410725 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-16787ac4-38f2-406c-99ac-9eecedb9f43f req-5381e740-afe1-454b-8e43-e58757419c85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e68f0d-86ed-4e9d-8bb9-06ca9638e690", "name": "network-vif-deleted", "tag": "5cdaad96-644e-4293-96b8-914e68d08378"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:42.419168 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-16787ac4-38f2-406c-99ac-9eecedb9f43f req-5381e740-afe1-454b-8e43-e58757419c85 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:42.419617 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-16787ac4-38f2-406c-99ac-9eecedb9f43f req-5381e740-afe1-454b-8e43-e58757419c85 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:42.434216 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-16787ac4-38f2-406c-99ac-9eecedb9f43f req-5381e740-afe1-454b-8e43-e58757419c85 service nova] Creating event network-vif-deleted:5cdaad96-644e-4293-96b8-914e68d08378 for instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 on hv-cinder-83607 May 26 17:01:42.440307 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-16787ac4-38f2-406c-99ac-9eecedb9f43f req-5381e740-afe1-454b-8e43-e58757419c85 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033375 May 26 17:01:42.440985 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 491/987] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:42.664650 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-cf6f2d34-2b91-47bc-8475-e80acb90e290 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:42.665287 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-cf6f2d34-2b91-47bc-8475-e80acb90e290 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:42.671979 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cf6f2d34-2b91-47bc-8475-e80acb90e290 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:42.672439 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cf6f2d34-2b91-47bc-8475-e80acb90e290 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:42.673213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cf6f2d34-2b91-47bc-8475-e80acb90e290 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:42.673708 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cf6f2d34-2b91-47bc-8475-e80acb90e290 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:42.740432 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-cf6f2d34-2b91-47bc-8475-e80acb90e290 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:42.749082 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-cf6f2d34-2b91-47bc-8475-e80acb90e290 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1615 microversion: 2.1 time: 0.088399 May 26 17:01:42.749690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 497/988] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:42 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1615 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:42.916910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-690657bf-0826-4ee7-ae81-0d8486a9b1ef tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:42.917665 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-690657bf-0826-4ee7-ae81-0d8486a9b1ef tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:42.925588 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-690657bf-0826-4ee7-ae81-0d8486a9b1ef tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:42.926045 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-690657bf-0826-4ee7-ae81-0d8486a9b1ef tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:42.926993 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-690657bf-0826-4ee7-ae81-0d8486a9b1ef tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:42.927555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-690657bf-0826-4ee7-ae81-0d8486a9b1ef tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:43.075176 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-690657bf-0826-4ee7-ae81-0d8486a9b1ef tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:43.087886 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-690657bf-0826-4ee7-ae81-0d8486a9b1ef tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.175391 May 26 17:01:43.088694 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 492/989] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:42 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:43.959347 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5b9989aa-fee2-40c9-9e4a-cdca3154ff67 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:43.959347 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5b9989aa-fee2-40c9-9e4a-cdca3154ff67 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:43.959347 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5b9989aa-fee2-40c9-9e4a-cdca3154ff67 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:43.959347 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5b9989aa-fee2-40c9-9e4a-cdca3154ff67 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:43.960009 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5b9989aa-fee2-40c9-9e4a-cdca3154ff67 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:43.960009 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5b9989aa-fee2-40c9-9e4a-cdca3154ff67 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:43.960009 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5b9989aa-fee2-40c9-9e4a-cdca3154ff67 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:43.960282 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5b9989aa-fee2-40c9-9e4a-cdca3154ff67 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1615 microversion: 2.1 time: 0.091055 May 26 17:01:43.960282 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 498/990] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:43 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1615 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:44.112297 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ef2db0ce-1c6d-4a51-87ff-c1cec1918b72 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:44.112912 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ef2db0ce-1c6d-4a51-87ff-c1cec1918b72 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:44.119404 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef2db0ce-1c6d-4a51-87ff-c1cec1918b72 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:44.119856 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef2db0ce-1c6d-4a51-87ff-c1cec1918b72 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:44.120614 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef2db0ce-1c6d-4a51-87ff-c1cec1918b72 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:44.121051 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ef2db0ce-1c6d-4a51-87ff-c1cec1918b72 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:44.256469 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ef2db0ce-1c6d-4a51-87ff-c1cec1918b72 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:44.269564 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ef2db0ce-1c6d-4a51-87ff-c1cec1918b72 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.155760 May 26 17:01:44.269564 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 493/991] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:44 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:44.871475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-35496424-a2d5-4006-a09b-0de266fc010c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:44.872081 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-35496424-a2d5-4006-a09b-0de266fc010c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:44.878568 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-35496424-a2d5-4006-a09b-0de266fc010c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:44.879010 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-35496424-a2d5-4006-a09b-0de266fc010c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:44.879760 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-35496424-a2d5-4006-a09b-0de266fc010c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:44.880198 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-35496424-a2d5-4006-a09b-0de266fc010c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:44.943392 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-35496424-a2d5-4006-a09b-0de266fc010c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:44.950960 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-35496424-a2d5-4006-a09b-0de266fc010c tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1615 microversion: 2.1 time: 0.083379 May 26 17:01:44.951522 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 499/992] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:44 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1615 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:45.285810 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4a2a4ff5-f2b9-4f8d-a934-b13f347759a9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:45.286852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4a2a4ff5-f2b9-4f8d-a934-b13f347759a9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:45.297971 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4a2a4ff5-f2b9-4f8d-a934-b13f347759a9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:45.299789 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4a2a4ff5-f2b9-4f8d-a934-b13f347759a9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:45.300007 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4a2a4ff5-f2b9-4f8d-a934-b13f347759a9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:45.300728 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4a2a4ff5-f2b9-4f8d-a934-b13f347759a9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:45.445724 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4a2a4ff5-f2b9-4f8d-a934-b13f347759a9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:45.454215 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4a2a4ff5-f2b9-4f8d-a934-b13f347759a9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.175779 May 26 17:01:45.454724 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 494/993] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:45 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:45.980542 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-26751906-0f26-422e-8b34-f8b17973b7fc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:45.980542 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-26751906-0f26-422e-8b34-f8b17973b7fc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:45.980542 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-26751906-0f26-422e-8b34-f8b17973b7fc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:45.980542 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-26751906-0f26-422e-8b34-f8b17973b7fc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:45.981475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-26751906-0f26-422e-8b34-f8b17973b7fc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:45.981475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-26751906-0f26-422e-8b34-f8b17973b7fc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:46.009127 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-26751906-0f26-422e-8b34-f8b17973b7fc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:46.009614 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-26751906-0f26-422e-8b34-f8b17973b7fc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:46.010072 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-26751906-0f26-422e-8b34-f8b17973b7fc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lazy-loading 'fault' on Instance uuid 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:01:46.054990 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-26751906-0f26-422e-8b34-f8b17973b7fc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1551f28754a64d1d9010ed90b67c5dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060af6cf4f7a48758f6859bd3766ae1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:46.064353 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-26751906-0f26-422e-8b34-f8b17973b7fc tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 200 len: 1331 microversion: 2.1 time: 0.100241 May 26 17:01:46.065193 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 500/994] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:45 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:46.472091 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ed183a2f-3fc6-46c4-9f58-0a243578a357 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:46.472727 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ed183a2f-3fc6-46c4-9f58-0a243578a357 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:46.479661 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed183a2f-3fc6-46c4-9f58-0a243578a357 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:46.480119 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed183a2f-3fc6-46c4-9f58-0a243578a357 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:46.480893 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed183a2f-3fc6-46c4-9f58-0a243578a357 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:46.481364 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ed183a2f-3fc6-46c4-9f58-0a243578a357 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:46.624004 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ed183a2f-3fc6-46c4-9f58-0a243578a357 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:46.631999 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ed183a2f-3fc6-46c4-9f58-0a243578a357 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.164470 May 26 17:01:46.632715 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 495/995] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:46 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:47.084461 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-97e6d476-0cc2-45d2-8f18-b547a8398cf8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:47.085118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-97e6d476-0cc2-45d2-8f18-b547a8398cf8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:47.093064 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-97e6d476-0cc2-45d2-8f18-b547a8398cf8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:47.093570 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-97e6d476-0cc2-45d2-8f18-b547a8398cf8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:47.094354 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-97e6d476-0cc2-45d2-8f18-b547a8398cf8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:47.094868 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-97e6d476-0cc2-45d2-8f18-b547a8398cf8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:47.109566 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-97e6d476-0cc2-45d2-8f18-b547a8398cf8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] HTTP exception thrown: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-97e6d476-0cc2-45d2-8f18-b547a8398cf8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Request method failure captured: May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 HTTP/1.1 May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7DzbhltvfRlN11wtcZ5l_X_WvcTEIigXlOrGIiq9Yx6XlBxWNmzLmNABRCmLnPTr4rRVR4UaIBjMcSZhnziOK1SfjgVmtsWHcVwpG_z7xB0-B1QZy0o_2qrsjZYhxYRjwS8MjkCFlKcl1g60M7fXrlp400fuazE8HitBHbMDtgjELA May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:01:47.114008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:01:47.115784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_060af6cf4f7a48758f6859bd3766ae1b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/060af6cf4f7a48758f6859bd3766ae1b"}]}] May 26 17:01:47.115784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:47.115784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:47.115784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:47.115784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:47.115784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:01:47.115784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:01:47.115784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 1551f28754a64d1d9010ed90b67c5dc4 May 26 17:01:47.115784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:47.115784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:01:47.115784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. May 26 17:01:47.115784 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '73e68f0d-86ed-4e9d-8bb9-06ca9638e690'} May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:01:47.116655 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. May 26 17:01:47.118118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:47.119305 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-97e6d476-0cc2-45d2-8f18-b547a8398cf8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Returning 404 to user: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:01:47.119305 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-97e6d476-0cc2-45d2-8f18-b547a8398cf8 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 404 len: 111 microversion: 2.1 time: 0.032443 May 26 17:01:47.119305 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 501/996] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:47 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:01:47.122461 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-df5eaf43-49dc-4974-8384-98fecb5c5c92 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '.version_select at 0x7fbe8055a280>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:47.126357 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR oslo.messaging._drivers.impl_rabbit [None req-df5eaf43-49dc-4974-8384-98fecb5c5c92 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [8a674573-5248-40fc-a9f5-21d77c66552c] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 17:01:47.649164 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b2218cdf-c374-46f2-ae27-4c2453c28ef8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:47.649764 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b2218cdf-c374-46f2-ae27-4c2453c28ef8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:47.655966 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b2218cdf-c374-46f2-ae27-4c2453c28ef8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:47.658536 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b2218cdf-c374-46f2-ae27-4c2453c28ef8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:47.658536 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b2218cdf-c374-46f2-ae27-4c2453c28ef8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:47.658536 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b2218cdf-c374-46f2-ae27-4c2453c28ef8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:47.815107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b2218cdf-c374-46f2-ae27-4c2453c28ef8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:47.822858 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b2218cdf-c374-46f2-ae27-4c2453c28ef8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1570 microversion: 2.1 time: 0.177591 May 26 17:01:47.823410 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 502/997] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:47 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:47.838680 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9dae6c56-03f1-4169-9f9a-a52dfba4a91a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:47.839241 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9dae6c56-03f1-4169-9f9a-a52dfba4a91a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:47.845721 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dae6c56-03f1-4169-9f9a-a52dfba4a91a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:47.846166 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dae6c56-03f1-4169-9f9a-a52dfba4a91a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:47.846928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dae6c56-03f1-4169-9f9a-a52dfba4a91a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:47.847365 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dae6c56-03f1-4169-9f9a-a52dfba4a91a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:47.862014 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:48.134344 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO oslo.messaging._drivers.impl_rabbit [None req-df5eaf43-49dc-4974-8384-98fecb5c5c92 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [8a674573-5248-40fc-a9f5-21d77c66552c] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 52822. May 26 17:01:48.208492 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9dae6c56-03f1-4169-9f9a-a52dfba4a91a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "POST /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c/action" status: 202 len: 0 microversion: 2.1 time: 0.373343 May 26 17:01:48.212048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 503/998] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 26 17:01:47 2022] POST /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:01:48.217006 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-eeeb49eb-0daf-4d71-a135-f1b97542f1cb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:48.219574 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-eeeb49eb-0daf-4d71-a135-f1b97542f1cb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:48.225606 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eeeb49eb-0daf-4d71-a135-f1b97542f1cb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:48.226065 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eeeb49eb-0daf-4d71-a135-f1b97542f1cb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:48.227019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eeeb49eb-0daf-4d71-a135-f1b97542f1cb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:48.227656 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eeeb49eb-0daf-4d71-a135-f1b97542f1cb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:48.236733 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-df5eaf43-49dc-4974-8384-98fecb5c5c92 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1825430007" status: 202 len: 0 microversion: 2.1 time: 1.118156 May 26 17:01:48.240142 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 496/999] 10.222.0.48 () {58 vars in 1220 bytes} [Thu May 26 17:01:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1825430007 => generated 0 bytes in 1120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:01:48.432106 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-eeeb49eb-0daf-4d71-a135-f1b97542f1cb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:48.447043 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-eeeb49eb-0daf-4d71-a135-f1b97542f1cb tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1518 microversion: 2.1 time: 0.233753 May 26 17:01:48.447827 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 504/1000] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:48 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1518 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:49.123235 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-bc25c52c-a996-452d-a8dd-e079d37198b7 req-387bd9ea-313d-4298-a825-9c761d9b9e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b981b012-8995-4185-9b5c-03934263a18c", "name": "network-vif-unplugged", "status": "completed", "tag": "dd6991b4-2331-41f4-a211-234d1b499987"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:49.132636 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-bc25c52c-a996-452d-a8dd-e079d37198b7 req-387bd9ea-313d-4298-a825-9c761d9b9e93 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:49.133092 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-bc25c52c-a996-452d-a8dd-e079d37198b7 req-387bd9ea-313d-4298-a825-9c761d9b9e93 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:49.159744 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.compute.server_external_events [req-bc25c52c-a996-452d-a8dd-e079d37198b7 req-387bd9ea-313d-4298-a825-9c761d9b9e93 service nova] Unable to find a host for instance b981b012-8995-4185-9b5c-03934263a18c. Dropping event network-vif-unplugged {{(pid=124837) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 17:01:49.161561 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-bc25c52c-a996-452d-a8dd-e079d37198b7 req-387bd9ea-313d-4298-a825-9c761d9b9e93 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.048698 May 26 17:01:49.162472 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 497/1001] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 17:01:49.464646 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-cc5fce35-80fa-44d6-9e8b-546f50116097 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:49.467569 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-cc5fce35-80fa-44d6-9e8b-546f50116097 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:49.477780 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cc5fce35-80fa-44d6-9e8b-546f50116097 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:49.481336 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cc5fce35-80fa-44d6-9e8b-546f50116097 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:49.482400 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cc5fce35-80fa-44d6-9e8b-546f50116097 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:49.483644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cc5fce35-80fa-44d6-9e8b-546f50116097 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:49.553623 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0a9f88ce-83dc-4305-ad5b-177d84a44998 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:49.554129 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0a9f88ce-83dc-4305-ad5b-177d84a44998 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:49.560278 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0a9f88ce-83dc-4305-ad5b-177d84a44998 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:49.560723 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0a9f88ce-83dc-4305-ad5b-177d84a44998 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:49.561651 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0a9f88ce-83dc-4305-ad5b-177d84a44998 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:49.562084 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0a9f88ce-83dc-4305-ad5b-177d84a44998 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:49.581039 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=100 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:49.627466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-cc5fce35-80fa-44d6-9e8b-546f50116097 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:49.635102 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-cc5fce35-80fa-44d6-9e8b-546f50116097 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1518 microversion: 2.1 time: 0.174698 May 26 17:01:49.636584 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 505/1002] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:49 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:49.664361 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-0a9f88ce-83dc-4305-ad5b-177d84a44998 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lazy-loading 'services' on Instance uuid 843b1744-ddc9-4aa5-800e-5e906b2b45e9 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:01:50.007273 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0a9f88ce-83dc-4305-ad5b-177d84a44998 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "DELETE /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9/os-volume_attachments/3d89415c-302c-4a84-ab98-502c611cec77" status: 202 len: 0 microversion: 2.1 time: 0.457722 May 26 17:01:50.008067 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 498/1003] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 26 17:01:49 2022] DELETE /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9/os-volume_attachments/3d89415c-302c-4a84-ab98-502c611cec77 => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:01:50.571836 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a8b6018c-2a18-4227-905b-003ab67e2c31 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:50.573898 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a8b6018c-2a18-4227-905b-003ab67e2c31 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:50.579458 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a8b6018c-2a18-4227-905b-003ab67e2c31 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:50.579974 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a8b6018c-2a18-4227-905b-003ab67e2c31 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:50.580773 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a8b6018c-2a18-4227-905b-003ab67e2c31 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:50.581219 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a8b6018c-2a18-4227-905b-003ab67e2c31 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:50.595440 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-a8b6018c-2a18-4227-905b-003ab67e2c31 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] HTTP exception thrown: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a8b6018c-2a18-4227-905b-003ab67e2c31 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Request method failure captured: May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: DELETE /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 HTTP/1.1 May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7DzbhltvfRlN11wtcZ5l_X_WvcTEIigXlOrGIiq9Yx6XlBxWNmzLmNABRCmLnPTr4rRVR4UaIBjMcSZhnziOK1SfjgVmtsWHcVwpG_z7xB0-B1QZy0o_2qrsjZYhxYRjwS8MjkCFlKcl1g60M7fXrlp400fuazE8HitBHbMDtgjELA May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:01:50.597037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:01:50.598707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_060af6cf4f7a48758f6859bd3766ae1b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/060af6cf4f7a48758f6859bd3766ae1b"}]}] May 26 17:01:50.598707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:50.598707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:50.598707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:50.598707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:50.598707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:01:50.598707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:01:50.598707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 1551f28754a64d1d9010ed90b67c5dc4 May 26 17:01:50.598707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:50.598707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:01:50.598707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. May 26 17:01:50.598707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '73e68f0d-86ed-4e9d-8bb9-06ca9638e690'} May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:01:50.599843 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. May 26 17:01:50.601039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:50.602301 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a8b6018c-2a18-4227-905b-003ab67e2c31 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Returning 404 to user: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:01:50.602301 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a8b6018c-2a18-4227-905b-003ab67e2c31 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "DELETE /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 404 len: 111 microversion: 2.1 time: 0.030643 May 26 17:01:50.602301 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 506/1004] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:01:50 2022] DELETE /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:01:50.609016 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6c2097aa-0851-41d6-af87-62f59b050f5b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:50.609820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6c2097aa-0851-41d6-af87-62f59b050f5b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 73e68f0d-86ed-4e9d-8bb9-06ca9638e690] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:50.612016 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:50.617173 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6c2097aa-0851-41d6-af87-62f59b050f5b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:50.619761 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6c2097aa-0851-41d6-af87-62f59b050f5b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:50.619761 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6c2097aa-0851-41d6-af87-62f59b050f5b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:50.619761 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-6c2097aa-0851-41d6-af87-62f59b050f5b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:50.635392 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-6c2097aa-0851-41d6-af87-62f59b050f5b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] HTTP exception thrown: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6c2097aa-0851-41d6-af87-62f59b050f5b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Request method failure captured: May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 HTTP/1.1 May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7DzbhltvfRlN11wtcZ5l_X_WvcTEIigXlOrGIiq9Yx6XlBxWNmzLmNABRCmLnPTr4rRVR4UaIBjMcSZhnziOK1SfjgVmtsWHcVwpG_z7xB0-B1QZy0o_2qrsjZYhxYRjwS8MjkCFlKcl1g60M7fXrlp400fuazE8HitBHbMDtgjELA May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:01:50.637049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:01:50.638791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_060af6cf4f7a48758f6859bd3766ae1b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/060af6cf4f7a48758f6859bd3766ae1b"}]}] May 26 17:01:50.638791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:50.638791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:50.638791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:50.638791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:50.638791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:01:50.638791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:01:50.638791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: 1551f28754a64d1d9010ed90b67c5dc4 May 26 17:01:50.638791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:50.638791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 17:01:50.638791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. May 26 17:01:50.638791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': '73e68f0d-86ed-4e9d-8bb9-06ca9638e690'} May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:01:50.640213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. May 26 17:01:50.641814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:50.643912 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6c2097aa-0851-41d6-af87-62f59b050f5b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Returning 404 to user: Instance 73e68f0d-86ed-4e9d-8bb9-06ca9638e690 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:01:50.643912 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6c2097aa-0851-41d6-af87-62f59b050f5b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690" status: 404 len: 111 microversion: 2.1 time: 0.034763 May 26 17:01:50.643912 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 499/1005] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:50 2022] GET /compute/v2.1/servers/73e68f0d-86ed-4e9d-8bb9-06ca9638e690 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:01:50.653852 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5fe7e6ea-51f2-4545-aca2-e180af6c3dca tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:50.654483 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5fe7e6ea-51f2-4545-aca2-e180af6c3dca tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:50.661253 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5fe7e6ea-51f2-4545-aca2-e180af6c3dca tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:50.661748 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5fe7e6ea-51f2-4545-aca2-e180af6c3dca tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:50.662523 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5fe7e6ea-51f2-4545-aca2-e180af6c3dca tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:50.662968 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5fe7e6ea-51f2-4545-aca2-e180af6c3dca tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:50.801467 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5fe7e6ea-51f2-4545-aca2-e180af6c3dca tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:50.809022 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5fe7e6ea-51f2-4545-aca2-e180af6c3dca tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1520 microversion: 2.1 time: 0.159015 May 26 17:01:50.809623 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 507/1006] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:50 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:51.826614 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-21cb28be-4371-4791-8b4f-bbaa95fc972d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:51.827230 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-21cb28be-4371-4791-8b4f-bbaa95fc972d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:51.834343 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-21cb28be-4371-4791-8b4f-bbaa95fc972d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:51.834791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-21cb28be-4371-4791-8b4f-bbaa95fc972d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:51.835558 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-21cb28be-4371-4791-8b4f-bbaa95fc972d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:51.835998 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-21cb28be-4371-4791-8b4f-bbaa95fc972d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:51.954776 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8ff4c075-7d6d-4fb9-943d-b9d71fb9c884 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:51.955389 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8ff4c075-7d6d-4fb9-943d-b9d71fb9c884 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:51.962699 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ff4c075-7d6d-4fb9-943d-b9d71fb9c884 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:51.963365 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ff4c075-7d6d-4fb9-943d-b9d71fb9c884 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:51.964455 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ff4c075-7d6d-4fb9-943d-b9d71fb9c884 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:51.964969 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ff4c075-7d6d-4fb9-943d-b9d71fb9c884 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:51.975243 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-21cb28be-4371-4791-8b4f-bbaa95fc972d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:51.980866 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-8ff4c075-7d6d-4fb9-943d-b9d71fb9c884 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] HTTP exception thrown: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8ff4c075-7d6d-4fb9-943d-b9d71fb9c884 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Request method failure captured: May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: DELETE /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 HTTP/1.1 May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7DzbhltvfRlN11wtcZ5l_X_WvcTEIigXlOrGIiq9Yx6XlBxWNmzLmNABRCmLnPTr4rRVR4UaIBjMcSZhnziOK1SfjgVmtsWHcVwpG_z7xB0-B1QZy0o_2qrsjZYhxYRjwS8MjkCFlKcl1g60M7fXrlp400fuazE8HitBHbMDtgjELA May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:01:51.982701 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:01:51.984342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_060af6cf4f7a48758f6859bd3766ae1b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/060af6cf4f7a48758f6859bd3766ae1b"}]}] May 26 17:01:51.984342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:51.984342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:51.984342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:51.984342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:51.984342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:01:51.984342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:01:51.984342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 1551f28754a64d1d9010ed90b67c5dc4 May 26 17:01:51.984342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:51.984342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:01:51.984342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. May 26 17:01:51.984342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3'} May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:01:51.985233 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. May 26 17:01:51.986466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:51.987666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8ff4c075-7d6d-4fb9-943d-b9d71fb9c884 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Returning 404 to user: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:01:51.987666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8ff4c075-7d6d-4fb9-943d-b9d71fb9c884 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 404 len: 111 microversion: 2.1 time: 0.034881 May 26 17:01:51.987666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 508/1007] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:01:51 2022] DELETE /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:01:51.988375 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-21cb28be-4371-4791-8b4f-bbaa95fc972d tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1520 microversion: 2.1 time: 0.160427 May 26 17:01:51.989121 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 500/1008] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:51 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:51.996468 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f96d05c7-f7da-4520-a85a-9fcff0f3092f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:51.996468 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f96d05c7-f7da-4520-a85a-9fcff0f3092f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:52.000627 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f96d05c7-f7da-4520-a85a-9fcff0f3092f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:52.004990 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f96d05c7-f7da-4520-a85a-9fcff0f3092f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:52.004990 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f96d05c7-f7da-4520-a85a-9fcff0f3092f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:52.004990 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f96d05c7-f7da-4520-a85a-9fcff0f3092f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:52.017332 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-f96d05c7-f7da-4520-a85a-9fcff0f3092f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] HTTP exception thrown: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f96d05c7-f7da-4520-a85a-9fcff0f3092f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Request method failure captured: May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 HTTP/1.1 May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7DzbhltvfRlN11wtcZ5l_X_WvcTEIigXlOrGIiq9Yx6XlBxWNmzLmNABRCmLnPTr4rRVR4UaIBjMcSZhnziOK1SfjgVmtsWHcVwpG_z7xB0-B1QZy0o_2qrsjZYhxYRjwS8MjkCFlKcl1g60M7fXrlp400fuazE8HitBHbMDtgjELA May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:01:52.018948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:01:52.020619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_060af6cf4f7a48758f6859bd3766ae1b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/060af6cf4f7a48758f6859bd3766ae1b"}]}] May 26 17:01:52.020619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:52.020619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:52.020619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:52.020619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:52.020619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:01:52.020619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:01:52.020619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 1551f28754a64d1d9010ed90b67c5dc4 May 26 17:01:52.020619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:52.020619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:01:52.020619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. May 26 17:01:52.020619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3'} May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:01:52.021577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. May 26 17:01:52.027567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:52.029107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f96d05c7-f7da-4520-a85a-9fcff0f3092f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Returning 404 to user: Instance 3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:01:52.029107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f96d05c7-f7da-4520-a85a-9fcff0f3092f tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3" status: 404 len: 111 microversion: 2.1 time: 0.032324 May 26 17:01:52.029107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 509/1009] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:51 2022] GET /compute/v2.1/servers/3547d9ef-4a8d-47e6-bbdd-74c492f1dcb3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:01:52.036592 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b4cb677f-114c-4344-92c4-a9cd374899fa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:52.041237 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b4cb677f-114c-4344-92c4-a9cd374899fa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:52.044639 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b4cb677f-114c-4344-92c4-a9cd374899fa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:52.045018 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b4cb677f-114c-4344-92c4-a9cd374899fa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:52.045899 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b4cb677f-114c-4344-92c4-a9cd374899fa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:52.047323 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b4cb677f-114c-4344-92c4-a9cd374899fa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:52.063279 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-b4cb677f-114c-4344-92c4-a9cd374899fa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] HTTP exception thrown: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b4cb677f-114c-4344-92c4-a9cd374899fa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Request method failure captured: May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e HTTP/1.1 May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7DzbhltvfRlN11wtcZ5l_X_WvcTEIigXlOrGIiq9Yx6XlBxWNmzLmNABRCmLnPTr4rRVR4UaIBjMcSZhnziOK1SfjgVmtsWHcVwpG_z7xB0-B1QZy0o_2qrsjZYhxYRjwS8MjkCFlKcl1g60M7fXrlp400fuazE8HitBHbMDtgjELA May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:01:52.064852 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:01:52.066659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_060af6cf4f7a48758f6859bd3766ae1b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/060af6cf4f7a48758f6859bd3766ae1b"}]}] May 26 17:01:52.066659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:52.066659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:52.066659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:52.066659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:52.066659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:01:52.066659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:01:52.066659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: 1551f28754a64d1d9010ed90b67c5dc4 May 26 17:01:52.066659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:52.066659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 17:01:52.066659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. May 26 17:01:52.066659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': '550e0ebe-517e-452c-97bf-ac35669bab9e'} May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:01:52.067538 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. May 26 17:01:52.069104 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:52.070636 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b4cb677f-114c-4344-92c4-a9cd374899fa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Returning 404 to user: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:01:52.070636 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b4cb677f-114c-4344-92c4-a9cd374899fa tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "DELETE /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 404 len: 111 microversion: 2.1 time: 0.039577 May 26 17:01:52.070636 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 501/1010] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:01:52 2022] DELETE /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:01:52.075605 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a41f0f27-6cea-47b3-9a22-5349fce3efe6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:52.078272 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a41f0f27-6cea-47b3-9a22-5349fce3efe6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 550e0ebe-517e-452c-97bf-ac35669bab9e] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:52.085517 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a41f0f27-6cea-47b3-9a22-5349fce3efe6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:52.086003 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a41f0f27-6cea-47b3-9a22-5349fce3efe6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:52.086807 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a41f0f27-6cea-47b3-9a22-5349fce3efe6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:52.087278 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a41f0f27-6cea-47b3-9a22-5349fce3efe6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:52.105153 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-a41f0f27-6cea-47b3-9a22-5349fce3efe6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] HTTP exception thrown: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a41f0f27-6cea-47b3-9a22-5349fce3efe6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Request method failure captured: May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e HTTP/1.1 May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7DzbhltvfRlN11wtcZ5l_X_WvcTEIigXlOrGIiq9Yx6XlBxWNmzLmNABRCmLnPTr4rRVR4UaIBjMcSZhnziOK1SfjgVmtsWHcVwpG_z7xB0-B1QZy0o_2qrsjZYhxYRjwS8MjkCFlKcl1g60M7fXrlp400fuazE8HitBHbMDtgjELA May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:01:52.106745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:01:52.108657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_060af6cf4f7a48758f6859bd3766ae1b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/060af6cf4f7a48758f6859bd3766ae1b"}]}] May 26 17:01:52.108657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:52.108657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:52.108657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:52.108657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:52.108657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:01:52.108657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:01:52.108657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 1551f28754a64d1d9010ed90b67c5dc4 May 26 17:01:52.108657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:52.108657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:01:52.108657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. May 26 17:01:52.108657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '550e0ebe-517e-452c-97bf-ac35669bab9e'} May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:01:52.109582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. May 26 17:01:52.111056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:52.112355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a41f0f27-6cea-47b3-9a22-5349fce3efe6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Returning 404 to user: Instance 550e0ebe-517e-452c-97bf-ac35669bab9e could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:01:52.112355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a41f0f27-6cea-47b3-9a22-5349fce3efe6 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e" status: 404 len: 111 microversion: 2.1 time: 0.037085 May 26 17:01:52.112355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 510/1011] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:52 2022] GET /compute/v2.1/servers/550e0ebe-517e-452c-97bf-ac35669bab9e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:01:53.006206 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7ab89546-42ff-4b24-ae37-33785d863725 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:53.007543 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7ab89546-42ff-4b24-ae37-33785d863725 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:53.015132 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7ab89546-42ff-4b24-ae37-33785d863725 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:53.015671 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7ab89546-42ff-4b24-ae37-33785d863725 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:53.016527 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7ab89546-42ff-4b24-ae37-33785d863725 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:53.017073 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7ab89546-42ff-4b24-ae37-33785d863725 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:53.169864 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7ab89546-42ff-4b24-ae37-33785d863725 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:53.178402 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7ab89546-42ff-4b24-ae37-33785d863725 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1576 microversion: 2.1 time: 0.176242 May 26 17:01:53.178972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 502/1012] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:53 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:53.271401 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-cf8afe0a-a12b-42a0-b859-6341880c4267 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:53.274065 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-cf8afe0a-a12b-42a0-b859-6341880c4267 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:53.281384 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cf8afe0a-a12b-42a0-b859-6341880c4267 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:53.281841 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cf8afe0a-a12b-42a0-b859-6341880c4267 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:53.282621 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cf8afe0a-a12b-42a0-b859-6341880c4267 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:53.283174 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-cf8afe0a-a12b-42a0-b859-6341880c4267 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:53.312850 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-cf8afe0a-a12b-42a0-b859-6341880c4267 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Going to try to terminate instance {{(pid=124836) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:01:53.416795 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-34f9629f-3ace-448f-8b0a-229c2a818a48 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:53.417323 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-34f9629f-3ace-448f-8b0a-229c2a818a48 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:53.425015 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34f9629f-3ace-448f-8b0a-229c2a818a48 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:53.425526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34f9629f-3ace-448f-8b0a-229c2a818a48 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:53.426321 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34f9629f-3ace-448f-8b0a-229c2a818a48 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:53.426758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34f9629f-3ace-448f-8b0a-229c2a818a48 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:53.441131 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-34f9629f-3ace-448f-8b0a-229c2a818a48 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] HTTP exception thrown: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-34f9629f-3ace-448f-8b0a-229c2a818a48 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Request method failure captured: May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 HTTP/1.1 May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7DzbhltvfRlN11wtcZ5l_X_WvcTEIigXlOrGIiq9Yx6XlBxWNmzLmNABRCmLnPTr4rRVR4UaIBjMcSZhnziOK1SfjgVmtsWHcVwpG_z7xB0-B1QZy0o_2qrsjZYhxYRjwS8MjkCFlKcl1g60M7fXrlp400fuazE8HitBHbMDtgjELA May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:01:53.442734 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:01:53.444293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_060af6cf4f7a48758f6859bd3766ae1b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/060af6cf4f7a48758f6859bd3766ae1b"}]}] May 26 17:01:53.444293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:53.444293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:53.444293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:53.444293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:53.444293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:01:53.444293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:01:53.444293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: 1551f28754a64d1d9010ed90b67c5dc4 May 26 17:01:53.444293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:53.444293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 17:01:53.444293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. May 26 17:01:53.444293 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': '922fbe1c-0632-41ec-b652-d4e1c457d234'} May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:01:53.445192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. May 26 17:01:53.446583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:53.448040 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-34f9629f-3ace-448f-8b0a-229c2a818a48 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Returning 404 to user: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:01:53.448040 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-34f9629f-3ace-448f-8b0a-229c2a818a48 tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "DELETE /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 404 len: 111 microversion: 2.1 time: 0.031373 May 26 17:01:53.448040 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 503/1013] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:01:53 2022] DELETE /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:01:53.452764 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f01dadbb-e825-4991-a424-0f30fef5117b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:53.453411 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f01dadbb-e825-4991-a424-0f30fef5117b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] [instance: 922fbe1c-0632-41ec-b652-d4e1c457d234] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:53.459599 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f01dadbb-e825-4991-a424-0f30fef5117b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:53.460045 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f01dadbb-e825-4991-a424-0f30fef5117b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:53.460873 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f01dadbb-e825-4991-a424-0f30fef5117b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:53.461344 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f01dadbb-e825-4991-a424-0f30fef5117b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:53.475495 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-f01dadbb-e825-4991-a424-0f30fef5117b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] HTTP exception thrown: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f01dadbb-e825-4991-a424-0f30fef5117b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Request method failure captured: May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 HTTP/1.1 May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7DzbhltvfRlN11wtcZ5l_X_WvcTEIigXlOrGIiq9Yx6XlBxWNmzLmNABRCmLnPTr4rRVR4UaIBjMcSZhnziOK1SfjgVmtsWHcVwpG_z7xB0-B1QZy0o_2qrsjZYhxYRjwS8MjkCFlKcl1g60M7fXrlp400fuazE8HitBHbMDtgjELA May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:01:53.477079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:01:53.479059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/060af6cf4f7a48758f6859bd3766ae1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_060af6cf4f7a48758f6859bd3766ae1b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/060af6cf4f7a48758f6859bd3766ae1b"}]}] May 26 17:01:53.479059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:53.479059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 060af6cf4f7a48758f6859bd3766ae1b May 26 17:01:53.479059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1609360552 May 26 17:01:53.479059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:53.479059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:01:53.479059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:01:53.479059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: 1551f28754a64d1d9010ed90b67c5dc4 May 26 17:01:53.479059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeNegativeTest-1609360552-project May 26 17:01:53.479059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 17:01:53.479059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. May 26 17:01:53.479059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': '922fbe1c-0632-41ec-b652-d4e1c457d234'} May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:01:53.480143 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. May 26 17:01:53.481765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:01:53.485888 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f01dadbb-e825-4991-a424-0f30fef5117b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] Returning 404 to user: Instance 922fbe1c-0632-41ec-b652-d4e1c457d234 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:01:53.485888 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f01dadbb-e825-4991-a424-0f30fef5117b tempest-AttachVolumeNegativeTest-1609360552 tempest-AttachVolumeNegativeTest-1609360552-project] 10.222.0.48 "GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234" status: 404 len: 111 microversion: 2.1 time: 0.029529 May 26 17:01:53.485888 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 504/1014] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:53 2022] GET /compute/v2.1/servers/922fbe1c-0632-41ec-b652-d4e1c457d234 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:01:53.639903 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-cf8afe0a-a12b-42a0-b859-6341880c4267 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "DELETE /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 204 len: 0 microversion: 2.1 time: 0.372425 May 26 17:01:53.640513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 511/1015] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:01:53 2022] DELETE /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:01:53.649846 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7331f436-bfd5-4927-8d30-79a7ad07910a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:53.650494 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7331f436-bfd5-4927-8d30-79a7ad07910a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:53.657398 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7331f436-bfd5-4927-8d30-79a7ad07910a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:53.657854 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7331f436-bfd5-4927-8d30-79a7ad07910a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:53.658655 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7331f436-bfd5-4927-8d30-79a7ad07910a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:53.659168 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7331f436-bfd5-4927-8d30-79a7ad07910a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:53.891163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7331f436-bfd5-4927-8d30-79a7ad07910a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:53.899116 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7331f436-bfd5-4927-8d30-79a7ad07910a tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1512 microversion: 2.1 time: 0.253496 May 26 17:01:53.900194 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 505/1016] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:53 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:54.204727 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e143cb2b-da58-4d45-8e78-8187aa6ef1cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:54.205821 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e143cb2b-da58-4d45-8e78-8187aa6ef1cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:54.214302 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e143cb2b-da58-4d45-8e78-8187aa6ef1cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:54.215134 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e143cb2b-da58-4d45-8e78-8187aa6ef1cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:54.216119 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e143cb2b-da58-4d45-8e78-8187aa6ef1cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:54.216646 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e143cb2b-da58-4d45-8e78-8187aa6ef1cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:54.483801 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e143cb2b-da58-4d45-8e78-8187aa6ef1cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:54.493249 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e143cb2b-da58-4d45-8e78-8187aa6ef1cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1576 microversion: 2.1 time: 0.295992 May 26 17:01:54.493845 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 512/1017] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:54 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1576 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:54.918283 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-34fbd884-86f5-4575-b16c-414d40965efe tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:54.919138 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-34fbd884-86f5-4575-b16c-414d40965efe tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:54.926164 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34fbd884-86f5-4575-b16c-414d40965efe tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:54.926736 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34fbd884-86f5-4575-b16c-414d40965efe tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:54.927698 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34fbd884-86f5-4575-b16c-414d40965efe tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:54.928150 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-34fbd884-86f5-4575-b16c-414d40965efe tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:55.081203 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-34fbd884-86f5-4575-b16c-414d40965efe tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:55.088893 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-34fbd884-86f5-4575-b16c-414d40965efe tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1512 microversion: 2.1 time: 0.174569 May 26 17:01:55.089479 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 506/1018] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:54 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:01:55.511117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-284b6027-bbb6-4c08-8439-30fc4bdef130 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:55.511737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-284b6027-bbb6-4c08-8439-30fc4bdef130 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:55.515689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:01:55.519623 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-284b6027-bbb6-4c08-8439-30fc4bdef130 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:55.520090 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-284b6027-bbb6-4c08-8439-30fc4bdef130 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:55.520894 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-284b6027-bbb6-4c08-8439-30fc4bdef130 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:55.521318 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-284b6027-bbb6-4c08-8439-30fc4bdef130 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:55.759511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-284b6027-bbb6-4c08-8439-30fc4bdef130 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:55.768662 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-284b6027-bbb6-4c08-8439-30fc4bdef130 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1576 microversion: 2.1 time: 0.261733 May 26 17:01:55.778960 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 513/1019] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:55 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1576 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:56.109820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a7318a38-81bd-4921-9895-6f71d8f45e55 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:56.110620 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a7318a38-81bd-4921-9895-6f71d8f45e55 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:56.132157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a7318a38-81bd-4921-9895-6f71d8f45e55 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:56.133456 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a7318a38-81bd-4921-9895-6f71d8f45e55 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:56.134977 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a7318a38-81bd-4921-9895-6f71d8f45e55 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:56.135524 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a7318a38-81bd-4921-9895-6f71d8f45e55 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:56.412653 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a7318a38-81bd-4921-9895-6f71d8f45e55 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:56.421197 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a7318a38-81bd-4921-9895-6f71d8f45e55 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1512 microversion: 2.1 time: 0.317863 May 26 17:01:56.422048 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 507/1020] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:56 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1512 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:56.497630 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-19134ba1-5585-4ed4-8344-cb47f0dc1273 req-a100dde0-ff45-4999-8272-3d78c97289d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "843b1744-ddc9-4aa5-800e-5e906b2b45e9", "name": "network-vif-deleted", "tag": "26d45251-b7a1-4efa-b018-af29198a4168"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:01:56.506785 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-19134ba1-5585-4ed4-8344-cb47f0dc1273 req-a100dde0-ff45-4999-8272-3d78c97289d7 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:56.507236 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-19134ba1-5585-4ed4-8344-cb47f0dc1273 req-a100dde0-ff45-4999-8272-3d78c97289d7 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:56.518909 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-19134ba1-5585-4ed4-8344-cb47f0dc1273 req-a100dde0-ff45-4999-8272-3d78c97289d7 service nova] Creating event network-vif-deleted:26d45251-b7a1-4efa-b018-af29198a4168 for instance 843b1744-ddc9-4aa5-800e-5e906b2b45e9 on hv-cinder-83607 May 26 17:01:56.523766 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-19134ba1-5585-4ed4-8344-cb47f0dc1273 req-a100dde0-ff45-4999-8272-3d78c97289d7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030179 May 26 17:01:56.524405 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 514/1021] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:01:56.787222 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1d42bae9-937c-422f-91b3-ebe727597228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:56.788139 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1d42bae9-937c-422f-91b3-ebe727597228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:56.794872 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d42bae9-937c-422f-91b3-ebe727597228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:56.796211 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d42bae9-937c-422f-91b3-ebe727597228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:56.797213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d42bae9-937c-422f-91b3-ebe727597228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:56.797801 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1d42bae9-937c-422f-91b3-ebe727597228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:56.946598 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1d42bae9-937c-422f-91b3-ebe727597228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:56.954329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1d42bae9-937c-422f-91b3-ebe727597228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1576 microversion: 2.1 time: 0.171524 May 26 17:01:56.954818 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 508/1022] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:56 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:57.442019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f9728648-7bd5-4861-b360-198b4fe99b03 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:57.442019 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f9728648-7bd5-4861-b360-198b4fe99b03 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:57.448168 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f9728648-7bd5-4861-b360-198b4fe99b03 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:57.448667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f9728648-7bd5-4861-b360-198b4fe99b03 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:57.449480 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f9728648-7bd5-4861-b360-198b4fe99b03 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:57.449964 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f9728648-7bd5-4861-b360-198b4fe99b03 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:57.488431 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f9728648-7bd5-4861-b360-198b4fe99b03 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:57.488903 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f9728648-7bd5-4861-b360-198b4fe99b03 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:57.489399 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-f9728648-7bd5-4861-b360-198b4fe99b03 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lazy-loading 'fault' on Instance uuid 843b1744-ddc9-4aa5-800e-5e906b2b45e9 {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:01:57.540114 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f9728648-7bd5-4861-b360-198b4fe99b03 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:57.548517 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f9728648-7bd5-4861-b360-198b4fe99b03 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 200 len: 1308 microversion: 2.1 time: 0.113192 May 26 17:01:57.552448 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 515/1023] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:57 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:57.971747 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d33a2456-67d3-4434-b2f2-7221c97aae16 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:57.972792 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d33a2456-67d3-4434-b2f2-7221c97aae16 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:57.980925 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d33a2456-67d3-4434-b2f2-7221c97aae16 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:57.981412 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d33a2456-67d3-4434-b2f2-7221c97aae16 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:57.982921 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d33a2456-67d3-4434-b2f2-7221c97aae16 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:57.983286 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d33a2456-67d3-4434-b2f2-7221c97aae16 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:58.200298 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d33a2456-67d3-4434-b2f2-7221c97aae16 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:58.208887 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d33a2456-67d3-4434-b2f2-7221c97aae16 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1576 microversion: 2.1 time: 0.242157 May 26 17:01:58.209509 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 509/1024] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:57 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1576 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:58.450129 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2f9ecdb5-a1de-48dc-a958-bc50fc679667 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:58.451226 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2f9ecdb5-a1de-48dc-a958-bc50fc679667 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:58.458433 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2f9ecdb5-a1de-48dc-a958-bc50fc679667 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:58.458881 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2f9ecdb5-a1de-48dc-a958-bc50fc679667 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:58.459726 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2f9ecdb5-a1de-48dc-a958-bc50fc679667 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:58.460163 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2f9ecdb5-a1de-48dc-a958-bc50fc679667 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:58.491257 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2f9ecdb5-a1de-48dc-a958-bc50fc679667 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045448 May 26 17:01:58.491834 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 516/1025] 10.222.0.48 () {60 vars in 1342 bytes} [Thu May 26 17:01:58 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:01:58.555602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-975b152f-ea04-4ff3-b1dd-feb7e0f40c9a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:58.556194 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-975b152f-ea04-4ff3-b1dd-feb7e0f40c9a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:58.563814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-975b152f-ea04-4ff3-b1dd-feb7e0f40c9a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:58.564694 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-975b152f-ea04-4ff3-b1dd-feb7e0f40c9a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:58.565686 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-975b152f-ea04-4ff3-b1dd-feb7e0f40c9a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:58.566252 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-975b152f-ea04-4ff3-b1dd-feb7e0f40c9a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:58.567586 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-89ec3ba1-497d-46f4-8829-49216f956db9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:58.568214 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-89ec3ba1-497d-46f4-8829-49216f956db9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: 843b1744-ddc9-4aa5-800e-5e906b2b45e9] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:58.583366 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-89ec3ba1-497d-46f4-8829-49216f956db9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:58.586312 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-89ec3ba1-497d-46f4-8829-49216f956db9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:58.586312 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-89ec3ba1-497d-46f4-8829-49216f956db9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:58.586312 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-89ec3ba1-497d-46f4-8829-49216f956db9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:58.597816 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-975b152f-ea04-4ff3-b1dd-feb7e0f40c9a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:01:58.603619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-89ec3ba1-497d-46f4-8829-49216f956db9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] HTTP exception thrown: Instance 843b1744-ddc9-4aa5-800e-5e906b2b45e9 could not be found. May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-89ec3ba1-497d-46f4-8829-49216f956db9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Request method failure captured: May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 HTTP/1.1 May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7Iupz17gQ__uHiLWU2lP8HQgqs2_ZS41vTIycvwzValcJ2f4B_0ITjkvtrg_bRg5Q9rat1NgTWN6zrpYWnDUZ1JbsqH8Rui8TBYT4vyectprR8MFDfJg6LoNe0zM6_d4e2W1f5bKxN03T14AdoaZZ94Nj4xb7hBp8zhnpk4-n8SRXs May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: c6ad6af479db4e92933ac0d1567f25e1 May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-VolumesSnapshotTestJSON-284750157 May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:01:58.605310 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:01:58.606757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6ad6af479db4e92933ac0d1567f25e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6ad6af479db4e92933ac0d1567f25e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c6ad6af479db4e92933ac0d1567f25e1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c6ad6af479db4e92933ac0d1567f25e1"}]}] May 26 17:01:58.606757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-VolumesSnapshotTestJSON-284750157 May 26 17:01:58.606757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: c6ad6af479db4e92933ac0d1567f25e1 May 26 17:01:58.606757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-284750157 May 26 17:01:58.606757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-VolumesSnapshotTestJSON-284750157-project May 26 17:01:58.606757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:01:58.606757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:01:58.606757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 284df7837ac84a98992207ac01587020 May 26 17:01:58.606757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-VolumesSnapshotTestJSON-284750157-project May 26 17:01:58.606757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:01:58.606757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 843b1744-ddc9-4aa5-800e-5e906b2b45e9 could not be found. May 26 17:01:58.606757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '843b1744-ddc9-4aa5-800e-5e906b2b45e9'} May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 843b1744-ddc9-4aa5-800e-5e906b2b45e9 could not be found. May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:01:58.608200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 843b1744-ddc9-4aa5-800e-5e906b2b45e9 could not be found. May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 843b1744-ddc9-4aa5-800e-5e906b2b45e9 could not be found. May 26 17:01:58.609671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:01:58.611085 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-89ec3ba1-497d-46f4-8829-49216f956db9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Returning 404 to user: Instance 843b1744-ddc9-4aa5-800e-5e906b2b45e9 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:01:58.611085 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-89ec3ba1-497d-46f4-8829-49216f956db9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9" status: 404 len: 111 microversion: 2.1 time: 0.044231 May 26 17:01:58.611085 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 517/1026] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:58 2022] GET /compute/v2.1/servers/843b1744-ddc9-4aa5-800e-5e906b2b45e9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:01:58.978819 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-975b152f-ea04-4ff3-b1dd-feb7e0f40c9a tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "DELETE /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 204 len: 0 microversion: 2.20 time: 0.428502 May 26 17:01:58.983382 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 510/1027] 10.222.0.48 () {60 vars in 1279 bytes} [Thu May 26 17:01:58 2022] DELETE /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 17:01:58.990531 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-05c81aa2-6b2d-4695-9916-069bd552398e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:58.991198 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-05c81aa2-6b2d-4695-9916-069bd552398e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:59.001513 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-05c81aa2-6b2d-4695-9916-069bd552398e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:59.001975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-05c81aa2-6b2d-4695-9916-069bd552398e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:59.002760 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-05c81aa2-6b2d-4695-9916-069bd552398e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:59.003199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-05c81aa2-6b2d-4695-9916-069bd552398e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:59.198389 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-05c81aa2-6b2d-4695-9916-069bd552398e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:59.207575 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-05c81aa2-6b2d-4695-9916-069bd552398e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:59.209389 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-05c81aa2-6b2d-4695-9916-069bd552398e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:59.210605 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-05c81aa2-6b2d-4695-9916-069bd552398e tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.225443 May 26 17:01:59.211162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 518/1028] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:01:58 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 17:01:59.227849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f82e2ed7-eea7-4c16-870f-71eb7b06dfb9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:01:59.230771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f82e2ed7-eea7-4c16-870f-71eb7b06dfb9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:01:59.236025 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f82e2ed7-eea7-4c16-870f-71eb7b06dfb9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:59.236025 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f82e2ed7-eea7-4c16-870f-71eb7b06dfb9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:59.237457 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f82e2ed7-eea7-4c16-870f-71eb7b06dfb9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:01:59.237777 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f82e2ed7-eea7-4c16-870f-71eb7b06dfb9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:01:59.387636 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f82e2ed7-eea7-4c16-870f-71eb7b06dfb9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:01:59.395893 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f82e2ed7-eea7-4c16-870f-71eb7b06dfb9 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1576 microversion: 2.1 time: 0.172745 May 26 17:01:59.397185 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 511/1029] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:01:59 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:00.229734 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7566e921-b8cd-4c96-8aef-801ab63fd1ae tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:00.230358 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7566e921-b8cd-4c96-8aef-801ab63fd1ae tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:00.237189 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7566e921-b8cd-4c96-8aef-801ab63fd1ae tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:00.237779 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7566e921-b8cd-4c96-8aef-801ab63fd1ae tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:00.238565 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7566e921-b8cd-4c96-8aef-801ab63fd1ae tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:00.239037 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7566e921-b8cd-4c96-8aef-801ab63fd1ae tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:00.368207 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7566e921-b8cd-4c96-8aef-801ab63fd1ae tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:00.376657 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7566e921-b8cd-4c96-8aef-801ab63fd1ae tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:00.378191 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7566e921-b8cd-4c96-8aef-801ab63fd1ae tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:00.379369 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7566e921-b8cd-4c96-8aef-801ab63fd1ae tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.153509 May 26 17:02:00.379927 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 519/1030] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:02:00 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:02:00.414396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f735e15e-5c24-433e-9a09-8215c51d08da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:00.415153 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f735e15e-5c24-433e-9a09-8215c51d08da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:00.422096 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f735e15e-5c24-433e-9a09-8215c51d08da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:00.422552 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f735e15e-5c24-433e-9a09-8215c51d08da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:00.423337 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f735e15e-5c24-433e-9a09-8215c51d08da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:00.423780 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f735e15e-5c24-433e-9a09-8215c51d08da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:00.561680 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f735e15e-5c24-433e-9a09-8215c51d08da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:00.569198 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f735e15e-5c24-433e-9a09-8215c51d08da tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1576 microversion: 2.1 time: 0.158740 May 26 17:02:00.569790 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 512/1031] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:00 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:01.398083 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ea2afce3-a06d-46fb-857d-be3ad8287c1c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:01.399103 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ea2afce3-a06d-46fb-857d-be3ad8287c1c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:01.405794 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ea2afce3-a06d-46fb-857d-be3ad8287c1c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:01.406250 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ea2afce3-a06d-46fb-857d-be3ad8287c1c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:01.407027 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ea2afce3-a06d-46fb-857d-be3ad8287c1c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:01.407466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ea2afce3-a06d-46fb-857d-be3ad8287c1c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:01.542648 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ea2afce3-a06d-46fb-857d-be3ad8287c1c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:01.544302 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ea2afce3-a06d-46fb-857d-be3ad8287c1c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:01.545866 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ea2afce3-a06d-46fb-857d-be3ad8287c1c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:01.547076 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ea2afce3-a06d-46fb-857d-be3ad8287c1c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.152995 May 26 17:02:01.547625 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 520/1032] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:02:01 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:02:01.586710 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1b43133c-6144-4626-94cb-46b61ecf3083 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:01.587327 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-1b43133c-6144-4626-94cb-46b61ecf3083 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:01.594891 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b43133c-6144-4626-94cb-46b61ecf3083 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:01.595338 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b43133c-6144-4626-94cb-46b61ecf3083 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:01.596099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b43133c-6144-4626-94cb-46b61ecf3083 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:01.596536 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-1b43133c-6144-4626-94cb-46b61ecf3083 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:01.727994 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-1b43133c-6144-4626-94cb-46b61ecf3083 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:01.735614 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1b43133c-6144-4626-94cb-46b61ecf3083 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1576 microversion: 2.1 time: 0.152803 May 26 17:02:01.736168 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 513/1033] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:01 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:02.564408 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-78a9d62e-949e-4baa-840a-9281f8b14865 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:02.565008 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-78a9d62e-949e-4baa-840a-9281f8b14865 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:02.571582 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-78a9d62e-949e-4baa-840a-9281f8b14865 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:02.576238 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-78a9d62e-949e-4baa-840a-9281f8b14865 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:02.576238 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-78a9d62e-949e-4baa-840a-9281f8b14865 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:02.576238 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-78a9d62e-949e-4baa-840a-9281f8b14865 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:02.577240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:02.707787 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-78a9d62e-949e-4baa-840a-9281f8b14865 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:02.717702 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-78a9d62e-949e-4baa-840a-9281f8b14865 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:02.723456 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-78a9d62e-949e-4baa-840a-9281f8b14865 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:02.723456 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-78a9d62e-949e-4baa-840a-9281f8b14865 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1722 microversion: 2.20 time: 0.159909 May 26 17:02:02.723456 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 521/1034] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:02:02 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:02:02.752351 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3886e093-2213-4bff-838c-3ce81c4d5ab1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:02.752970 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3886e093-2213-4bff-838c-3ce81c4d5ab1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:02.759627 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3886e093-2213-4bff-838c-3ce81c4d5ab1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:02.760080 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3886e093-2213-4bff-838c-3ce81c4d5ab1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:02.760859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3886e093-2213-4bff-838c-3ce81c4d5ab1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:02.761318 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3886e093-2213-4bff-838c-3ce81c4d5ab1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:02.909385 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3886e093-2213-4bff-838c-3ce81c4d5ab1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:02.918652 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3886e093-2213-4bff-838c-3ce81c4d5ab1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1576 microversion: 2.1 time: 0.170216 May 26 17:02:02.919240 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 514/1035] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:02 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:03.373801 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-12150a00-0298-41a7-8106-fe646e1c8889 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] Calling method '.version_select at 0x7fbe804ef790>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:03.425419 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-12150a00-0298-41a7-8106-fe646e1c8889 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/5f2d2d8b-f716-45b3-be70-36f709051ea5" status: 200 len: 351 microversion: 2.1 time: 0.055878 May 26 17:02:03.431876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 522/1036] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 26 17:02:03 2022] GET /compute/v2.1/os-volumes/5f2d2d8b-f716-45b3-be70-36f709051ea5 => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:03.616015 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-b00b1663-19d4-49c6-badd-7820abdacc65 req-4004ea4c-283d-4251-acb0-ed6b00eef0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ca388b-87f7-46b3-81f0-5e7d06e9dcc1", "name": "network-vif-deleted", "tag": "17153ebf-8de6-4b1d-bafd-f2c2e8580998"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:03.625818 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-b00b1663-19d4-49c6-badd-7820abdacc65 req-4004ea4c-283d-4251-acb0-ed6b00eef0d1 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:03.626310 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-b00b1663-19d4-49c6-badd-7820abdacc65 req-4004ea4c-283d-4251-acb0-ed6b00eef0d1 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:03.639427 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-b00b1663-19d4-49c6-badd-7820abdacc65 req-4004ea4c-283d-4251-acb0-ed6b00eef0d1 service nova] Creating event network-vif-deleted:17153ebf-8de6-4b1d-bafd-f2c2e8580998 for instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 on hv-cinder-83607 May 26 17:02:03.644672 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-b00b1663-19d4-49c6-badd-7820abdacc65 req-4004ea4c-283d-4251-acb0-ed6b00eef0d1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033381 May 26 17:02:03.645874 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 515/1037] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:03.744966 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-bb55590e-653e-41f6-9cd4-be108a81e336 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:03.745725 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-bb55590e-653e-41f6-9cd4-be108a81e336 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:03.754296 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bb55590e-653e-41f6-9cd4-be108a81e336 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:03.754755 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bb55590e-653e-41f6-9cd4-be108a81e336 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:03.755541 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bb55590e-653e-41f6-9cd4-be108a81e336 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:03.755986 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bb55590e-653e-41f6-9cd4-be108a81e336 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:03.829044 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-bb55590e-653e-41f6-9cd4-be108a81e336 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:03.840754 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-bb55590e-653e-41f6-9cd4-be108a81e336 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:03.842656 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-bb55590e-653e-41f6-9cd4-be108a81e336 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '89f20368c3a747a49a3aaa556115d169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a16c7d70bb14cd3b898751084649cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:03.843935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-bb55590e-653e-41f6-9cd4-be108a81e336 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 200 len: 1365 microversion: 2.20 time: 0.107294 May 26 17:02:03.844380 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 523/1038] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:02:03 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 17:02:03.937413 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-57db8c21-bd94-4d25-aa9f-fca53b8298cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:03.939001 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-57db8c21-bd94-4d25-aa9f-fca53b8298cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:03.946890 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-57db8c21-bd94-4d25-aa9f-fca53b8298cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:03.947430 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-57db8c21-bd94-4d25-aa9f-fca53b8298cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:03.948196 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-57db8c21-bd94-4d25-aa9f-fca53b8298cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:03.948846 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-57db8c21-bd94-4d25-aa9f-fca53b8298cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:03.953726 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:04.105740 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-57db8c21-bd94-4d25-aa9f-fca53b8298cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:04.119013 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-57db8c21-bd94-4d25-aa9f-fca53b8298cf tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1576 microversion: 2.1 time: 0.186063 May 26 17:02:04.119593 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 516/1039] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:03 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:04.862999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ddbf2cc5-e6a7-47eb-9103-fa266b998ebc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:04.863551 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ddbf2cc5-e6a7-47eb-9103-fa266b998ebc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:04.870032 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ddbf2cc5-e6a7-47eb-9103-fa266b998ebc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:04.870484 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ddbf2cc5-e6a7-47eb-9103-fa266b998ebc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:04.871248 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ddbf2cc5-e6a7-47eb-9103-fa266b998ebc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:04.871681 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ddbf2cc5-e6a7-47eb-9103-fa266b998ebc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:04.886031 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-ddbf2cc5-e6a7-47eb-9103-fa266b998ebc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] HTTP exception thrown: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ddbf2cc5-e6a7-47eb-9103-fa266b998ebc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Request method failure captured: May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 HTTP/1.1 May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7CMO7vth5eNDcoH0uz1xJNZdPXIZnJLGNtQq4hjl3sTAcyM9bTxVOIlXLoAqJUWVO9-AwO5XimbF_dn1eKAMayd6r5UUnykoRR3-I1zg_VgHC6V1ooZ8TUqg792dtGpI58oG1rI2FW9B69QLh8I76O7tvP1kLQrJ56fbfNGZd_dSb8 May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Openstack-Nova-Api-Version: 2.20 May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 5a16c7d70bb14cd3b898751084649cd2 May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-709675682 May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:02:04.887618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:02:04.889501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a16c7d70bb14cd3b898751084649cd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a16c7d70bb14cd3b898751084649cd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5a16c7d70bb14cd3b898751084649cd2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5a16c7d70bb14cd3b898751084649cd2"}]}] May 26 17:02:04.889501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeShelveTestJSON-709675682 May 26 17:02:04.889501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 5a16c7d70bb14cd3b898751084649cd2 May 26 17:02:04.889501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-709675682 May 26 17:02:04.889501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeShelveTestJSON-709675682-project May 26 17:02:04.889501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:02:04.889501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:02:04.889501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 89f20368c3a747a49a3aaa556115d169 May 26 17:02:04.889501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeShelveTestJSON-709675682-project May 26 17:02:04.889501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:02:04.889501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. May 26 17:02:04.889501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '10ca388b-87f7-46b3-81f0-5e7d06e9dcc1'} May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:04.890689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. May 26 17:02:04.892300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:04.893890 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ddbf2cc5-e6a7-47eb-9103-fa266b998ebc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Returning 404 to user: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:04.893890 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ddbf2cc5-e6a7-47eb-9103-fa266b998ebc tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 404 len: 111 microversion: 2.20 time: 0.030131 May 26 17:02:04.893890 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 524/1040] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:02:04 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 17:02:04.898581 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0047fa02-6232-4749-831a-a5b13b7a2dcf tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '.version_select at 0x7fbe804ffc10>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:05.110267 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0047fa02-6232-4749-831a-a5b13b7a2dcf tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-307988715" status: 204 len: 0 microversion: 2.20 time: 0.215891 May 26 17:02:05.111042 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 517/1041] 10.222.0.48 () {60 vars in 1258 bytes} [Thu May 26 17:02:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-307988715 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 17:02:05.137185 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b58edbaa-aa8e-4004-9554-4bfc38d8cea8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:05.137828 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b58edbaa-aa8e-4004-9554-4bfc38d8cea8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:05.173148 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b58edbaa-aa8e-4004-9554-4bfc38d8cea8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:05.177546 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b58edbaa-aa8e-4004-9554-4bfc38d8cea8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:05.178973 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b58edbaa-aa8e-4004-9554-4bfc38d8cea8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:05.179770 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b58edbaa-aa8e-4004-9554-4bfc38d8cea8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:05.229779 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-83015a3a-b799-4336-8d3e-b90c42f1d083 req-d69df1f3-4e6f-4b15-82a7-964edd5a8967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b981b012-8995-4185-9b5c-03934263a18c", "name": "network-vif-plugged", "status": "completed", "tag": "dd6991b4-2331-41f4-a211-234d1b499987"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:05.246440 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-83015a3a-b799-4336-8d3e-b90c42f1d083 req-d69df1f3-4e6f-4b15-82a7-964edd5a8967 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:05.247136 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-83015a3a-b799-4336-8d3e-b90c42f1d083 req-d69df1f3-4e6f-4b15-82a7-964edd5a8967 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:05.261861 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-83015a3a-b799-4336-8d3e-b90c42f1d083 req-d69df1f3-4e6f-4b15-82a7-964edd5a8967 service nova] Creating event network-vif-plugged:dd6991b4-2331-41f4-a211-234d1b499987 for instance b981b012-8995-4185-9b5c-03934263a18c on hv-cinder-83607 May 26 17:02:05.268021 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-83015a3a-b799-4336-8d3e-b90c42f1d083 req-d69df1f3-4e6f-4b15-82a7-964edd5a8967 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041950 May 26 17:02:05.268690 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 518/1042] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:05.273928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2fbf0695-548e-437e-8915-ae2109f7ab94 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] Calling method '.version_select at 0x7fbe805fa940>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:05.323290 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2fbf0695-548e-437e-8915-ae2109f7ab94 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a481f7f6-186a-45e6-9b7c-16bfd39b46cc" status: 200 len: 350 microversion: 2.1 time: 0.053289 May 26 17:02:05.323866 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 519/1043] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 26 17:02:05 2022] GET /compute/v2.1/os-volumes/a481f7f6-186a-45e6-9b7c-16bfd39b46cc => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:05.371570 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b58edbaa-aa8e-4004-9554-4bfc38d8cea8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:05.380674 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b58edbaa-aa8e-4004-9554-4bfc38d8cea8 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1576 microversion: 2.1 time: 0.247270 May 26 17:02:05.381597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 525/1044] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:05 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1576 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:06.402289 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a40f027d-2545-47c6-9a90-91e89c648b43 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:06.403022 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a40f027d-2545-47c6-9a90-91e89c648b43 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:06.409936 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a40f027d-2545-47c6-9a90-91e89c648b43 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:06.410397 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a40f027d-2545-47c6-9a90-91e89c648b43 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:06.411173 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a40f027d-2545-47c6-9a90-91e89c648b43 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:06.411618 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a40f027d-2545-47c6-9a90-91e89c648b43 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:06.547518 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a40f027d-2545-47c6-9a90-91e89c648b43 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:06.555268 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a40f027d-2545-47c6-9a90-91e89c648b43 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1576 microversion: 2.1 time: 0.157750 May 26 17:02:06.555831 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 520/1045] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:06 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:07.572201 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-84f7289c-0d34-4241-8127-dde98af5c7bd tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:07.572792 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-84f7289c-0d34-4241-8127-dde98af5c7bd tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:07.579511 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-84f7289c-0d34-4241-8127-dde98af5c7bd tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:07.579985 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-84f7289c-0d34-4241-8127-dde98af5c7bd tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:07.580735 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-84f7289c-0d34-4241-8127-dde98af5c7bd tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:07.581167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-84f7289c-0d34-4241-8127-dde98af5c7bd tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:07.709681 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-84f7289c-0d34-4241-8127-dde98af5c7bd tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:07.717877 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-84f7289c-0d34-4241-8127-dde98af5c7bd tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1576 microversion: 2.1 time: 0.149552 May 26 17:02:07.718441 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 526/1046] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:07 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:08.735888 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5fbcdf35-db97-4699-8428-4cbaa6ec81ee tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:08.736498 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5fbcdf35-db97-4699-8428-4cbaa6ec81ee tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:08.743140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5fbcdf35-db97-4699-8428-4cbaa6ec81ee tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:08.743593 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5fbcdf35-db97-4699-8428-4cbaa6ec81ee tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:08.744364 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5fbcdf35-db97-4699-8428-4cbaa6ec81ee tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:08.744807 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5fbcdf35-db97-4699-8428-4cbaa6ec81ee tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:08.881110 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5fbcdf35-db97-4699-8428-4cbaa6ec81ee tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:08.889205 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5fbcdf35-db97-4699-8428-4cbaa6ec81ee tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1576 microversion: 2.1 time: 0.157939 May 26 17:02:08.889822 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 521/1047] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:08 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:09.215733 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-71919bde-d72a-4a95-805f-f5c9e88a56dc tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] Calling method '.version_select at 0x7fbe8049b310>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:09.268163 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-71919bde-d72a-4a95-805f-f5c9e88a56dc tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/5b739051-39d1-4723-a468-c5be4c1ea0f5" status: 200 len: 350 microversion: 2.1 time: 0.056282 May 26 17:02:09.268828 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 527/1048] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 26 17:02:09 2022] GET /compute/v2.1/os-volumes/5b739051-39d1-4723-a468-c5be4c1ea0f5 => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:09.281174 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-df8e0904-08fa-428f-ad89-df08ac01b5a2 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] Calling method '.version_select at 0x7fbe8068bc10>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:09.370298 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-df8e0904-08fa-428f-ad89-df08ac01b5a2 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.093663 May 26 17:02:09.371030 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 522/1049] 10.222.0.48 () {58 vars in 1133 bytes} [Thu May 26 17:02:09 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:09.382892 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ee87f018-7fc1-481c-8abb-57e11d986faa tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] Calling method '.version_select at 0x7fbe804ef820>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:09.391991 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-609682398", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452", "networks": [{"uuid": "12a87d45-8370-4248-b552-63dea63c9b5d"}]}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:09.450348 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] validate_networks() for [('12a87d45-8370-4248-b552-63dea63c9b5d', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:02:09.466300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ee87f018-7fc1-481c-8abb-57e11d986faa tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.087160 May 26 17:02:09.467474 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 528/1050] 10.222.0.48 () {58 vars in 1148 bytes} [Thu May 26 17:02:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:09.472577 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5f589197-790f-4f1d-be68-c9d12dd24d53 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:09.473314 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5f589197-790f-4f1d-be68-c9d12dd24d53 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:09.481041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5f589197-790f-4f1d-be68-c9d12dd24d53 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:09.481535 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5f589197-790f-4f1d-be68-c9d12dd24d53 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:09.482323 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5f589197-790f-4f1d-be68-c9d12dd24d53 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:09.482766 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5f589197-790f-4f1d-be68-c9d12dd24d53 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:09.496089 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-5f589197-790f-4f1d-be68-c9d12dd24d53 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] HTTP exception thrown: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5f589197-790f-4f1d-be68-c9d12dd24d53 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Request method failure captured: May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: DELETE /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 HTTP/1.1 May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7CMO7vth5eNDcoH0uz1xJNZdPXIZnJLGNtQq4hjl3sTAcyM9bTxVOIlXLoAqJUWVO9-AwO5XimbF_dn1eKAMayd6r5UUnykoRR3-I1zg_VgHC6V1ooZ8TUqg792dtGpI58oG1rI2FW9B69QLh8I76O7tvP1kLQrJ56fbfNGZd_dSb8 May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Openstack-Nova-Api-Version: 2.20 May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 5a16c7d70bb14cd3b898751084649cd2 May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-709675682 May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:02:09.497867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:02:09.499550 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a16c7d70bb14cd3b898751084649cd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a16c7d70bb14cd3b898751084649cd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5a16c7d70bb14cd3b898751084649cd2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5a16c7d70bb14cd3b898751084649cd2"}]}] May 26 17:02:09.499550 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeShelveTestJSON-709675682 May 26 17:02:09.499550 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 5a16c7d70bb14cd3b898751084649cd2 May 26 17:02:09.499550 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-709675682 May 26 17:02:09.499550 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeShelveTestJSON-709675682-project May 26 17:02:09.499550 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:02:09.499550 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:02:09.499550 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 89f20368c3a747a49a3aaa556115d169 May 26 17:02:09.499550 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeShelveTestJSON-709675682-project May 26 17:02:09.499550 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:02:09.499550 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. May 26 17:02:09.499550 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '10ca388b-87f7-46b3-81f0-5e7d06e9dcc1'} May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:09.500379 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. May 26 17:02:09.501711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:09.503307 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5f589197-790f-4f1d-be68-c9d12dd24d53 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Returning 404 to user: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:09.503307 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5f589197-790f-4f1d-be68-c9d12dd24d53 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "DELETE /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 404 len: 111 microversion: 2.20 time: 0.030807 May 26 17:02:09.503307 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 529/1051] 10.222.0.48 () {60 vars in 1279 bytes} [Thu May 26 17:02:09 2022] DELETE /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 17:02:09.505798 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-98ce001b-f37e-4770-8205-e84c12c62d39 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] Calling method '.version_select at 0x7fbe80459c10>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:09.595763 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-98ce001b-f37e-4770-8205-e84c12c62d39 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.094567 May 26 17:02:09.596501 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 530/1052] 10.222.0.48 () {58 vars in 1133 bytes} [Thu May 26 17:02:09 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:09.601353 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-69bec298-bbf0-4e51-9e78-b862ddd1f78c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:09.601981 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-69bec298-bbf0-4e51-9e78-b862ddd1f78c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:09.609494 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69bec298-bbf0-4e51-9e78-b862ddd1f78c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:09.609942 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69bec298-bbf0-4e51-9e78-b862ddd1f78c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:09.610833 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69bec298-bbf0-4e51-9e78-b862ddd1f78c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:09.611146 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69bec298-bbf0-4e51-9e78-b862ddd1f78c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:09.624855 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-69bec298-bbf0-4e51-9e78-b862ddd1f78c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] HTTP exception thrown: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-69bec298-bbf0-4e51-9e78-b862ddd1f78c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Request method failure captured: May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 HTTP/1.1 May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7CMO7vth5eNDcoH0uz1xJNZdPXIZnJLGNtQq4hjl3sTAcyM9bTxVOIlXLoAqJUWVO9-AwO5XimbF_dn1eKAMayd6r5UUnykoRR3-I1zg_VgHC6V1ooZ8TUqg792dtGpI58oG1rI2FW9B69QLh8I76O7tvP1kLQrJ56fbfNGZd_dSb8 May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Openstack-Nova-Api-Version: 2.20 May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 5a16c7d70bb14cd3b898751084649cd2 May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-709675682 May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:02:09.626616 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:02:09.628331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a16c7d70bb14cd3b898751084649cd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a16c7d70bb14cd3b898751084649cd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5a16c7d70bb14cd3b898751084649cd2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5a16c7d70bb14cd3b898751084649cd2"}]}] May 26 17:02:09.628331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeShelveTestJSON-709675682 May 26 17:02:09.628331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 5a16c7d70bb14cd3b898751084649cd2 May 26 17:02:09.628331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-709675682 May 26 17:02:09.628331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeShelveTestJSON-709675682-project May 26 17:02:09.628331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:02:09.628331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:02:09.628331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 89f20368c3a747a49a3aaa556115d169 May 26 17:02:09.628331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeShelveTestJSON-709675682-project May 26 17:02:09.628331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:02:09.628331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. May 26 17:02:09.628331 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '10ca388b-87f7-46b3-81f0-5e7d06e9dcc1'} May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:09.629112 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. May 26 17:02:09.630666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:09.632046 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-69bec298-bbf0-4e51-9e78-b862ddd1f78c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Returning 404 to user: Instance 10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:09.632046 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-69bec298-bbf0-4e51-9e78-b862ddd1f78c tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1" status: 404 len: 111 microversion: 2.20 time: 0.030582 May 26 17:02:09.632046 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 531/1053] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:02:09 2022] GET /compute/v2.1/servers/10ca388b-87f7-46b3-81f0-5e7d06e9dcc1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 17:02:09.633198 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2749dc7d-57f5-44a9-a1fe-8785b4c91740 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] Calling method '.version_select at 0x7fbe80701160>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:09.836696 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:02:09.837424 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:02:09.838075 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:02:09.838559 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:02:09.839058 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:02:09.850016 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:09.850569 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:09.851477 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:09.851991 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:09.871578 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Getting quotas for project c6ad6af479db4e92933ac0d1567f25e1. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:02:09.876117 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Getting quotas for user 284df7837ac84a98992207ac01587020 and project c6ad6af479db4e92933ac0d1567f25e1. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:02:09.889325 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:02:09.891859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:02:09.904825 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2749dc7d-57f5-44a9-a1fe-8785b4c91740 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.274757 May 26 17:02:09.905804 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 532/1054] 10.222.0.48 () {58 vars in 1166 bytes} [Thu May 26 17:02:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:09.910280 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-94f250f9-2aeb-42a8-b213-697b6d01d1c0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:09.911611 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-94f250f9-2aeb-42a8-b213-697b6d01d1c0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:09.919339 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94f250f9-2aeb-42a8-b213-697b6d01d1c0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:09.920431 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94f250f9-2aeb-42a8-b213-697b6d01d1c0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:09.921167 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94f250f9-2aeb-42a8-b213-697b6d01d1c0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:09.921614 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94f250f9-2aeb-42a8-b213-697b6d01d1c0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:10.052796 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2e1fa837-9e09-4337-b20b-be2ed63d69ea tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665713 May 26 17:02:10.053463 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 523/1055] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 17:02:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 17:02:10.059783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-94f250f9-2aeb-42a8-b213-697b6d01d1c0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:10.062459 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2181d01e-4442-49e5-a7fd-d24f7eed6ad5 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] Calling method '.version_select at 0x7fbe8079dee0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:10.069216 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-94f250f9-2aeb-42a8-b213-697b6d01d1c0 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1563 microversion: 2.1 time: 0.162563 May 26 17:02:10.070228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 533/1056] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:09 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:10.076716 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-eefb72d1-2719-436c-944b-180722be9c2d tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:10.077632 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-eefb72d1-2719-436c-944b-180722be9c2d tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:10.134300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-eefb72d1-2719-436c-944b-180722be9c2d tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:10.141228 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-eefb72d1-2719-436c-944b-180722be9c2d tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1218 microversion: 2.1 time: 0.069736 May 26 17:02:10.141824 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 534/1057] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:10 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:10.166042 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2181d01e-4442-49e5-a7fd-d24f7eed6ad5 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.108352 May 26 17:02:10.166748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 524/1058] 10.222.0.48 () {58 vars in 1169 bytes} [Thu May 26 17:02:10 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:10.178955 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b1b7d15c-9177-49ca-a0de-b175023724b0 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] Calling method '.version_select at 0x7fbe804f25e0>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:10.265191 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b1b7d15c-9177-49ca-a0de-b175023724b0 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087929 May 26 17:02:10.265191 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 535/1059] 10.222.0.48 () {58 vars in 1154 bytes} [Thu May 26 17:02:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:10.275524 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-da8d63be-792e-4a34-b746-eba167ccb153 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] Calling method '.version_select at 0x7fbe804a0f70>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:10.356343 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-da8d63be-792e-4a34-b746-eba167ccb153 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084607 May 26 17:02:10.356924 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 525/1060] 10.222.0.48 () {58 vars in 1187 bytes} [Thu May 26 17:02:10 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:10.368980 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-d04ef0b5-fa1a-4150-8432-c831528f8869 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] Calling method '.version_select at 0x7fbe8037b550>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:10.449747 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-d04ef0b5-fa1a-4150-8432-c831528f8869 tempest-VolumesTestJSON-1188811466 tempest-VolumesTestJSON-1188811466-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084476 May 26 17:02:10.450350 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 536/1061] 10.222.0.48 () {58 vars in 1154 bytes} [Thu May 26 17:02:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:10.973307 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3267e7a7-6abb-4cb0-b4e8-a877da632237 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:10.973833 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3267e7a7-6abb-4cb0-b4e8-a877da632237 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:10.980344 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3267e7a7-6abb-4cb0-b4e8-a877da632237 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:10.980791 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3267e7a7-6abb-4cb0-b4e8-a877da632237 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:10.981629 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3267e7a7-6abb-4cb0-b4e8-a877da632237 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:10.982568 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3267e7a7-6abb-4cb0-b4e8-a877da632237 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:10.997467 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-3267e7a7-6abb-4cb0-b4e8-a877da632237 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] HTTP exception thrown: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3267e7a7-6abb-4cb0-b4e8-a877da632237 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Request method failure captured: May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa HTTP/1.1 May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7CMO7vth5eNDcoH0uz1xJNZdPXIZnJLGNtQq4hjl3sTAcyM9bTxVOIlXLoAqJUWVO9-AwO5XimbF_dn1eKAMayd6r5UUnykoRR3-I1zg_VgHC6V1ooZ8TUqg792dtGpI58oG1rI2FW9B69QLh8I76O7tvP1kLQrJ56fbfNGZd_dSb8 May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Openstack-Nova-Api-Version: 2.20 May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 5a16c7d70bb14cd3b898751084649cd2 May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-709675682 May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:02:10.999820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:02:11.001603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a16c7d70bb14cd3b898751084649cd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a16c7d70bb14cd3b898751084649cd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5a16c7d70bb14cd3b898751084649cd2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5a16c7d70bb14cd3b898751084649cd2"}]}] May 26 17:02:11.001603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-AttachVolumeShelveTestJSON-709675682 May 26 17:02:11.001603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 5a16c7d70bb14cd3b898751084649cd2 May 26 17:02:11.001603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-709675682 May 26 17:02:11.001603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-AttachVolumeShelveTestJSON-709675682-project May 26 17:02:11.001603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:02:11.001603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:02:11.001603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: 89f20368c3a747a49a3aaa556115d169 May 26 17:02:11.001603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-AttachVolumeShelveTestJSON-709675682-project May 26 17:02:11.001603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 17:02:11.001603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. May 26 17:02:11.001603 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': 'd0daf7ae-8eab-479b-b4cb-380a68f5bfaa'} May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:11.002428 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. May 26 17:02:11.003972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:11.005840 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3267e7a7-6abb-4cb0-b4e8-a877da632237 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Returning 404 to user: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:11.005840 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3267e7a7-6abb-4cb0-b4e8-a877da632237 tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 404 len: 111 microversion: 2.20 time: 0.032598 May 26 17:02:11.005840 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 526/1062] 10.222.0.48 () {60 vars in 1279 bytes} [Thu May 26 17:02:10 2022] DELETE /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 17:02:11.009992 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a8ec012a-cc8c-4855-a803-6bd84926ac2f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:11.010643 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a8ec012a-cc8c-4855-a803-6bd84926ac2f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] [instance: d0daf7ae-8eab-479b-b4cb-380a68f5bfaa] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:11.017137 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a8ec012a-cc8c-4855-a803-6bd84926ac2f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:11.017637 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a8ec012a-cc8c-4855-a803-6bd84926ac2f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:11.018412 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a8ec012a-cc8c-4855-a803-6bd84926ac2f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:11.018858 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a8ec012a-cc8c-4855-a803-6bd84926ac2f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:11.032374 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-a8ec012a-cc8c-4855-a803-6bd84926ac2f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] HTTP exception thrown: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a8ec012a-cc8c-4855-a803-6bd84926ac2f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Request method failure captured: May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa HTTP/1.1 May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7CMO7vth5eNDcoH0uz1xJNZdPXIZnJLGNtQq4hjl3sTAcyM9bTxVOIlXLoAqJUWVO9-AwO5XimbF_dn1eKAMayd6r5UUnykoRR3-I1zg_VgHC6V1ooZ8TUqg792dtGpI58oG1rI2FW9B69QLh8I76O7tvP1kLQrJ56fbfNGZd_dSb8 May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Openstack-Nova-Api-Version: 2.20 May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 5a16c7d70bb14cd3b898751084649cd2 May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-709675682 May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:02:11.033975 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:02:11.035677 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a16c7d70bb14cd3b898751084649cd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5a16c7d70bb14cd3b898751084649cd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5a16c7d70bb14cd3b898751084649cd2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5a16c7d70bb14cd3b898751084649cd2"}]}] May 26 17:02:11.035677 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-AttachVolumeShelveTestJSON-709675682 May 26 17:02:11.035677 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 5a16c7d70bb14cd3b898751084649cd2 May 26 17:02:11.035677 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-709675682 May 26 17:02:11.035677 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-AttachVolumeShelveTestJSON-709675682-project May 26 17:02:11.035677 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:02:11.035677 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:02:11.035677 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 89f20368c3a747a49a3aaa556115d169 May 26 17:02:11.035677 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-AttachVolumeShelveTestJSON-709675682-project May 26 17:02:11.035677 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:02:11.035677 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. May 26 17:02:11.035677 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': 'd0daf7ae-8eab-479b-b4cb-380a68f5bfaa'} May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:11.036567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. May 26 17:02:11.038121 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:11.039495 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a8ec012a-cc8c-4855-a803-6bd84926ac2f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] Returning 404 to user: Instance d0daf7ae-8eab-479b-b4cb-380a68f5bfaa could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:11.039495 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a8ec012a-cc8c-4855-a803-6bd84926ac2f tempest-AttachVolumeShelveTestJSON-709675682 tempest-AttachVolumeShelveTestJSON-709675682-project] 10.222.0.48 "GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa" status: 404 len: 111 microversion: 2.20 time: 0.029386 May 26 17:02:11.039495 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 537/1063] 10.222.0.48 () {60 vars in 1276 bytes} [Thu May 26 17:02:11 2022] GET /compute/v2.1/servers/d0daf7ae-8eab-479b-b4cb-380a68f5bfaa => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 17:02:11.160425 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ca7a9aa9-32db-494c-b1de-9d9e566430bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:11.161748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ca7a9aa9-32db-494c-b1de-9d9e566430bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:11.170380 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca7a9aa9-32db-494c-b1de-9d9e566430bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:11.171468 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca7a9aa9-32db-494c-b1de-9d9e566430bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:11.173157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca7a9aa9-32db-494c-b1de-9d9e566430bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:11.173920 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca7a9aa9-32db-494c-b1de-9d9e566430bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:11.239559 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ca7a9aa9-32db-494c-b1de-9d9e566430bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:11.249310 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ca7a9aa9-32db-494c-b1de-9d9e566430bb tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1222 microversion: 2.1 time: 0.094281 May 26 17:02:11.249707 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 527/1064] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:11 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:12.268558 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6cda37ac-b946-4e11-b346-f8904aa631df tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:12.269837 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6cda37ac-b946-4e11-b346-f8904aa631df tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:12.276883 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6cda37ac-b946-4e11-b346-f8904aa631df tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:12.277909 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6cda37ac-b946-4e11-b346-f8904aa631df tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:12.278767 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6cda37ac-b946-4e11-b346-f8904aa631df tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:12.279478 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6cda37ac-b946-4e11-b346-f8904aa631df tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:12.353022 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6cda37ac-b946-4e11-b346-f8904aa631df tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:12.361965 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6cda37ac-b946-4e11-b346-f8904aa631df tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1278 microversion: 2.1 time: 0.100204 May 26 17:02:12.362534 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 538/1065] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:12 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1278 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:13.380171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4fd438dd-5eed-4cac-8113-1156ae426698 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:13.380881 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4fd438dd-5eed-4cac-8113-1156ae426698 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:13.399928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4fd438dd-5eed-4cac-8113-1156ae426698 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:13.400391 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4fd438dd-5eed-4cac-8113-1156ae426698 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:13.401448 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4fd438dd-5eed-4cac-8113-1156ae426698 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:13.402066 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4fd438dd-5eed-4cac-8113-1156ae426698 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:13.509241 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4fd438dd-5eed-4cac-8113-1156ae426698 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:13.517073 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4fd438dd-5eed-4cac-8113-1156ae426698 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1276 microversion: 2.1 time: 0.141410 May 26 17:02:13.517611 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 528/1066] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:13 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1276 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:14.534705 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-85588866-0145-4e2c-b0d6-d8aa8c6b112e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:14.535318 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-85588866-0145-4e2c-b0d6-d8aa8c6b112e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:14.542618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-85588866-0145-4e2c-b0d6-d8aa8c6b112e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:14.543077 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-85588866-0145-4e2c-b0d6-d8aa8c6b112e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:14.543852 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-85588866-0145-4e2c-b0d6-d8aa8c6b112e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:14.544298 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-85588866-0145-4e2c-b0d6-d8aa8c6b112e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:14.682075 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-85588866-0145-4e2c-b0d6-d8aa8c6b112e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:14.690012 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-85588866-0145-4e2c-b0d6-d8aa8c6b112e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1318 microversion: 2.1 time: 0.159143 May 26 17:02:14.690594 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 539/1067] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:14 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:14.819697 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-c8fd5838-afdb-4664-87e0-34439851e5a1 req-d04d6846-3a79-4129-918f-0b26ebcc96e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206", "tag": "a7c57a24-10c9-4532-8724-446c0b104bfc"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:14.833190 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-c8fd5838-afdb-4664-87e0-34439851e5a1 req-d04d6846-3a79-4129-918f-0b26ebcc96e2 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:14.839673 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-c8fd5838-afdb-4664-87e0-34439851e5a1 req-d04d6846-3a79-4129-918f-0b26ebcc96e2 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:14.862365 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-c8fd5838-afdb-4664-87e0-34439851e5a1 req-d04d6846-3a79-4129-918f-0b26ebcc96e2 service nova] Creating event network-changed:a7c57a24-10c9-4532-8724-446c0b104bfc for instance f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 on hv-cinder-83607 May 26 17:02:14.879699 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-c8fd5838-afdb-4664-87e0-34439851e5a1 req-d04d6846-3a79-4129-918f-0b26ebcc96e2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063974 May 26 17:02:14.881009 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 529/1068] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:15.707668 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ef84f039-efca-4429-b255-da20c567cd93 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:15.708297 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ef84f039-efca-4429-b255-da20c567cd93 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:15.714662 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ef84f039-efca-4429-b255-da20c567cd93 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:15.715116 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ef84f039-efca-4429-b255-da20c567cd93 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:15.715890 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ef84f039-efca-4429-b255-da20c567cd93 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:15.716989 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ef84f039-efca-4429-b255-da20c567cd93 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:15.859066 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ef84f039-efca-4429-b255-da20c567cd93 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:15.866787 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ef84f039-efca-4429-b255-da20c567cd93 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1318 microversion: 2.1 time: 0.163450 May 26 17:02:15.867278 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 540/1069] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:15 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:16.885211 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f6aaf44e-e0d0-424c-b1c2-85034b61f3f4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:16.885949 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f6aaf44e-e0d0-424c-b1c2-85034b61f3f4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:16.892913 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f6aaf44e-e0d0-424c-b1c2-85034b61f3f4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:16.893419 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f6aaf44e-e0d0-424c-b1c2-85034b61f3f4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:16.894340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f6aaf44e-e0d0-424c-b1c2-85034b61f3f4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:16.894785 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f6aaf44e-e0d0-424c-b1c2-85034b61f3f4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:17.049393 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f6aaf44e-e0d0-424c-b1c2-85034b61f3f4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:17.056897 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f6aaf44e-e0d0-424c-b1c2-85034b61f3f4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1318 microversion: 2.1 time: 0.176651 May 26 17:02:17.057499 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 530/1070] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:16 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:17.558263 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6aa2b237-3ae2-460e-9550-ed36ac844391 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Action: 'create', calling method: .version_select at 0x7fbe806d2af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1648501576"}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:18.076280 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f091d7ba-8ffb-4afc-9fba-ff62aebbfed0 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:18.076910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f091d7ba-8ffb-4afc-9fba-ff62aebbfed0 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:18.084192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f091d7ba-8ffb-4afc-9fba-ff62aebbfed0 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:18.084646 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f091d7ba-8ffb-4afc-9fba-ff62aebbfed0 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:18.085470 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f091d7ba-8ffb-4afc-9fba-ff62aebbfed0 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:18.085913 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f091d7ba-8ffb-4afc-9fba-ff62aebbfed0 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:18.230958 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f091d7ba-8ffb-4afc-9fba-ff62aebbfed0 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:18.238621 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f091d7ba-8ffb-4afc-9fba-ff62aebbfed0 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1318 microversion: 2.1 time: 0.167073 May 26 17:02:18.239213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 531/1071] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:18 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:18.408863 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6aa2b237-3ae2-460e-9550-ed36ac844391 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.976377 May 26 17:02:18.415280 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 541/1072] 10.222.0.48 () {60 vars in 1154 bytes} [Thu May 26 17:02:17 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 978 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 17:02:18.421210 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-288c8f2d-fe12-4b7a-ba2f-7b1584511049 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe8068bf70>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:18.502279 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-288c8f2d-fe12-4b7a-ba2f-7b1584511049 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e" status: 200 len: 345 microversion: 2.1 time: 0.085057 May 26 17:02:18.504432 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 532/1073] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 26 17:02:18 2022] GET /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e => generated 345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:19.256667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-26e97054-1b8a-421b-81c5-8e0a00119258 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:19.257410 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-26e97054-1b8a-421b-81c5-8e0a00119258 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:19.265651 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-26e97054-1b8a-421b-81c5-8e0a00119258 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:19.266189 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-26e97054-1b8a-421b-81c5-8e0a00119258 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:19.267020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-26e97054-1b8a-421b-81c5-8e0a00119258 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:19.267405 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-26e97054-1b8a-421b-81c5-8e0a00119258 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:19.416450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-26e97054-1b8a-421b-81c5-8e0a00119258 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:19.426413 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-26e97054-1b8a-421b-81c5-8e0a00119258 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1318 microversion: 2.1 time: 0.173982 May 26 17:02:19.427004 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 542/1074] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:19 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:19.518050 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3128c8bb-1354-4341-bd72-5ef7d87ec53a tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe8055a790>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:19.591285 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3128c8bb-1354-4341-bd72-5ef7d87ec53a tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e" status: 200 len: 346 microversion: 2.1 time: 0.072026 May 26 17:02:19.591285 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 533/1075] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 26 17:02:19 2022] GET /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:19.597901 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f1a23dcd-72d7-436b-8ef2-4c8316e9c82e tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Action: 'create', calling method: .version_select at 0x7fbe804f2ca0>, body: {"snapshot": {"volume_id": "eaa79799-8a7b-4cd5-b829-b5f63ae73a0e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-495262040"}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:20.122659 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f1a23dcd-72d7-436b-8ef2-4c8316e9c82e tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.527578 May 26 17:02:20.122659 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 543/1076] 10.222.0.48 () {60 vars in 1161 bytes} [Thu May 26 17:02:19 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:20.133227 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a591a895-55c5-47aa-a49b-ce32598b0cbb tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe8057c0d0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:20.147800 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:20.148599 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=6 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:20.180282 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a591a895-55c5-47aa-a49b-ce32598b0cbb tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70" status: 200 len: 286 microversion: 2.1 time: 0.051956 May 26 17:02:20.185866 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 534/1077] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 26 17:02:20 2022] GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:20.189324 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:20.193772 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b40d5461-0848-469a-95bd-329256b2f0af tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe806e7ca0>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:20.231326 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b40d5461-0848-469a-95bd-329256b2f0af tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.042496 May 26 17:02:20.237835 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 544/1078] 10.222.0.48 () {58 vars in 1139 bytes} [Thu May 26 17:02:20 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:20.244638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-014b58e8-e751-4e82-a483-408d3e0e5569 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe80595af0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:20.277540 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-014b58e8-e751-4e82-a483-408d3e0e5569 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70" status: 200 len: 286 microversion: 2.1 time: 0.037276 May 26 17:02:20.278216 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 535/1079] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 26 17:02:20 2022] GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:20.445519 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-74e69d87-5964-43d2-8ce7-31d63e262500 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:20.446231 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-74e69d87-5964-43d2-8ce7-31d63e262500 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:20.454094 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-74e69d87-5964-43d2-8ce7-31d63e262500 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:20.456945 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-74e69d87-5964-43d2-8ce7-31d63e262500 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:20.456945 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-74e69d87-5964-43d2-8ce7-31d63e262500 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:20.456945 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-74e69d87-5964-43d2-8ce7-31d63e262500 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:20.600535 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-74e69d87-5964-43d2-8ce7-31d63e262500 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:20.608596 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-74e69d87-5964-43d2-8ce7-31d63e262500 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1318 microversion: 2.1 time: 0.168441 May 26 17:02:20.609520 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 545/1080] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:20 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:21.291087 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-cf37dcba-b36a-4cb2-9d6d-b1a381ea4bc3 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe805e6af0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:21.327819 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-cf37dcba-b36a-4cb2-9d6d-b1a381ea4bc3 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70" status: 200 len: 286 microversion: 2.1 time: 0.041443 May 26 17:02:21.328396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 536/1081] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 26 17:02:21 2022] GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:21.627162 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-24fc7130-be9c-4db0-b697-562a208cb7aa tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:21.627779 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-24fc7130-be9c-4db0-b697-562a208cb7aa tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:21.634745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-24fc7130-be9c-4db0-b697-562a208cb7aa tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:21.635215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-24fc7130-be9c-4db0-b697-562a208cb7aa tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:21.635970 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-24fc7130-be9c-4db0-b697-562a208cb7aa tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:21.636411 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-24fc7130-be9c-4db0-b697-562a208cb7aa tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:21.854234 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-24fc7130-be9c-4db0-b697-562a208cb7aa tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:21.863024 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-24fc7130-be9c-4db0-b697-562a208cb7aa tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1318 microversion: 2.1 time: 0.240464 May 26 17:02:21.863782 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 546/1082] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:21 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:22.340571 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fd233a4b-3b0d-4574-b0d2-080aef011a66 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe805d3e50>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:22.381049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fd233a4b-3b0d-4574-b0d2-080aef011a66 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70" status: 200 len: 286 microversion: 2.1 time: 0.044739 May 26 17:02:22.382611 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 537/1083] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 26 17:02:22 2022] GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70 => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:22.880586 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7d4acd50-0c4a-4303-9dba-184174a828ec tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:22.881250 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7d4acd50-0c4a-4303-9dba-184174a828ec tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:22.888327 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7d4acd50-0c4a-4303-9dba-184174a828ec tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:22.890029 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7d4acd50-0c4a-4303-9dba-184174a828ec tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:22.890029 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7d4acd50-0c4a-4303-9dba-184174a828ec tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:22.890293 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7d4acd50-0c4a-4303-9dba-184174a828ec tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:23.041236 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7d4acd50-0c4a-4303-9dba-184174a828ec tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:23.049712 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7d4acd50-0c4a-4303-9dba-184174a828ec tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1318 microversion: 2.1 time: 0.173088 May 26 17:02:23.050280 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 547/1084] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:22 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:23.393437 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-10aee51d-dc33-4305-bbf1-053e786e3394 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe8068b4c0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:23.424176 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-10aee51d-dc33-4305-bbf1-053e786e3394 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70" status: 200 len: 286 microversion: 2.1 time: 0.035287 May 26 17:02:23.424750 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 538/1085] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 26 17:02:23 2022] GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:23.751977 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-8cb33c2b-c694-49b1-aff8-4b3cfbca773c req-aa073660-98cc-40ab-a802-0538f21757e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206", "name": "network-vif-plugged", "status": "completed", "tag": "a7c57a24-10c9-4532-8724-446c0b104bfc"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:23.760096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-8cb33c2b-c694-49b1-aff8-4b3cfbca773c req-aa073660-98cc-40ab-a802-0538f21757e4 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:23.760538 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-8cb33c2b-c694-49b1-aff8-4b3cfbca773c req-aa073660-98cc-40ab-a802-0538f21757e4 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:23.771390 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-8cb33c2b-c694-49b1-aff8-4b3cfbca773c req-aa073660-98cc-40ab-a802-0538f21757e4 service nova] Creating event network-vif-plugged:a7c57a24-10c9-4532-8724-446c0b104bfc for instance f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 on hv-cinder-83607 May 26 17:02:23.776399 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-8cb33c2b-c694-49b1-aff8-4b3cfbca773c req-aa073660-98cc-40ab-a802-0538f21757e4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028709 May 26 17:02:23.776993 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 548/1086] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:24.067070 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-91de86a2-7c3e-4e02-9d2e-c489d70c0f41 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:24.067708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-91de86a2-7c3e-4e02-9d2e-c489d70c0f41 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:24.069779 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:24.074882 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91de86a2-7c3e-4e02-9d2e-c489d70c0f41 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:24.075991 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91de86a2-7c3e-4e02-9d2e-c489d70c0f41 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:24.080028 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91de86a2-7c3e-4e02-9d2e-c489d70c0f41 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:24.080028 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-91de86a2-7c3e-4e02-9d2e-c489d70c0f41 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:24.250443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-91de86a2-7c3e-4e02-9d2e-c489d70c0f41 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:24.257301 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-91de86a2-7c3e-4e02-9d2e-c489d70c0f41 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1318 microversion: 2.1 time: 0.194286 May 26 17:02:24.257870 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 539/1087] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:24 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:24.437549 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-99e3c0e4-4aa8-4bb9-b351-751b4d63d4b8 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe80701f70>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:24.471133 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-99e3c0e4-4aa8-4bb9-b351-751b4d63d4b8 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70" status: 200 len: 287 microversion: 2.1 time: 0.038688 May 26 17:02:24.471675 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 549/1088] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 26 17:02:24 2022] GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:24.483241 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f115cff5-08d4-4bc6-a697-0cb62b089232 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe8051c280>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:24.600728 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f115cff5-08d4-4bc6-a697-0cb62b089232 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70" status: 202 len: 0 microversion: 2.1 time: 0.121810 May 26 17:02:24.604367 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 540/1089] 10.222.0.48 () {58 vars in 1253 bytes} [Thu May 26 17:02:24 2022] DELETE /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:02:24.609770 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-0ce1e0aa-1083-42b2-9959-676fbc5f6ba6 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe80524a60>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:24.644182 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-0ce1e0aa-1083-42b2-9959-676fbc5f6ba6 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70" status: 200 len: 286 microversion: 2.1 time: 0.038437 May 26 17:02:24.644846 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 550/1090] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 26 17:02:24 2022] GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:25.274596 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a69d48b2-c1df-4a05-954d-4c18cd2fa681 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:25.275336 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a69d48b2-c1df-4a05-954d-4c18cd2fa681 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:25.282127 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a69d48b2-c1df-4a05-954d-4c18cd2fa681 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:25.282706 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a69d48b2-c1df-4a05-954d-4c18cd2fa681 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:25.283480 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a69d48b2-c1df-4a05-954d-4c18cd2fa681 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:25.283922 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a69d48b2-c1df-4a05-954d-4c18cd2fa681 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:25.423301 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a69d48b2-c1df-4a05-954d-4c18cd2fa681 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:25.430790 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a69d48b2-c1df-4a05-954d-4c18cd2fa681 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1318 microversion: 2.1 time: 0.160099 May 26 17:02:25.431362 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 541/1091] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:25 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:25.656902 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6e864b70-0cf4-4191-b6e1-4d734c11ad24 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe80601670>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:25.693682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6e864b70-0cf4-4191-b6e1-4d734c11ad24 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70" status: 200 len: 286 microversion: 2.1 time: 0.037267 May 26 17:02:25.693682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 551/1092] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 26 17:02:25 2022] GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:26.448825 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-251315e3-9578-41d5-a3da-8f324952b08e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:26.449475 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-251315e3-9578-41d5-a3da-8f324952b08e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:26.456762 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-251315e3-9578-41d5-a3da-8f324952b08e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:26.457217 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-251315e3-9578-41d5-a3da-8f324952b08e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:26.458012 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-251315e3-9578-41d5-a3da-8f324952b08e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:26.458452 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-251315e3-9578-41d5-a3da-8f324952b08e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:26.596278 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-251315e3-9578-41d5-a3da-8f324952b08e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:26.604115 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-251315e3-9578-41d5-a3da-8f324952b08e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1318 microversion: 2.1 time: 0.159158 May 26 17:02:26.611506 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 542/1093] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:26 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:26.702342 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-bb5a47c7-c304-4810-a8e0-ea54b8aa6da1 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe80412af0>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:26.733102 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-bb5a47c7-c304-4810-a8e0-ea54b8aa6da1 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70" status: 200 len: 286 microversion: 2.1 time: 0.035864 May 26 17:02:26.733839 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 552/1094] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 26 17:02:26 2022] GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:27.620748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-dfa9edc0-6697-4e34-9650-055f95f1f4c4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:27.621393 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-dfa9edc0-6697-4e34-9650-055f95f1f4c4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:27.628815 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dfa9edc0-6697-4e34-9650-055f95f1f4c4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:27.629277 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dfa9edc0-6697-4e34-9650-055f95f1f4c4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:27.630060 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dfa9edc0-6697-4e34-9650-055f95f1f4c4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:27.630497 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dfa9edc0-6697-4e34-9650-055f95f1f4c4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:27.744042 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7efa53cd-99f6-413f-a8b6-878723f3975f tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe8037b310>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:27.773847 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-dfa9edc0-6697-4e34-9650-055f95f1f4c4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:27.782171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-dfa9edc0-6697-4e34-9650-055f95f1f4c4 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1318 microversion: 2.1 time: 0.165620 May 26 17:02:27.782744 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 543/1095] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:27 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:27.825780 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-7efa53cd-99f6-413f-a8b6-878723f3975f tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] HTTP exception thrown: Snapshot 4360605e-ea0f-44fd-a7fc-8f549499fd70 could not be found. May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7efa53cd-99f6-413f-a8b6-878723f3975f tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Request method failure captured: May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70 HTTP/1.1 May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7KZupEgNjjoaBYM8TJ2_bdU5Lx32CS2IKD7wu5fuqDOVCBaIliB5oxa_D3Rm2u50b7AzjXUuTGVcAgCOGyu8TVNrsJFDfSO12JKPnFOaCKrQ-AUuyt_m1i-2RI0-UcSlIh6nnx-c4pOqDqn-AbY9qMM12meGFGbFdIfWw8J_kZBKf0 May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 385f893eb30e4767a469a8279332dcf0 May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2141228092 May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:02:27.837200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:02:27.839018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/385f893eb30e4767a469a8279332dcf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/385f893eb30e4767a469a8279332dcf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_385f893eb30e4767a469a8279332dcf0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/385f893eb30e4767a469a8279332dcf0"}]}] May 26 17:02:27.839018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2141228092 May 26 17:02:27.839018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 385f893eb30e4767a469a8279332dcf0 May 26 17:02:27.839018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2141228092 May 26 17:02:27.839018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-VolumesSnapshotsTestJSON-2141228092-project May 26 17:02:27.839018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:02:27.839018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:02:27.839018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 1186267f6b0f4f7ba4f493003aabfa77 May 26 17:02:27.839018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2141228092-project May 26 17:02:27.839018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: May 26 17:02:27.839018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Snapshot 4360605e-ea0f-44fd-a7fc-8f549499fd70 could not be found. May 26 17:02:27.839018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '4360605e-ea0f-44fd-a7fc-8f549499fd70'} May 26 17:02:27.839018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4360605e-ea0f-44fd-a7fc-8f549499fd70 could not be found. (HTTP 404) (Request-ID: req-f4ea1f72-45c1-45f4-8534-24d48b77fac4) May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:27.840096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:02:27.842999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4360605e-ea0f-44fd-a7fc-8f549499fd70 could not be found. May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 17:02:27.845213 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:27.847813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4360605e-ea0f-44fd-a7fc-8f549499fd70 could not be found. May 26 17:02:27.847813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:27.847813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:27.847813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:27.847813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:27.847813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:27.847813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:27.847813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:27.847813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:27.847813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4360605e-ea0f-44fd-a7fc-8f549499fd70 could not be found. May 26 17:02:27.847813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:27.847813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7efa53cd-99f6-413f-a8b6-878723f3975f tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Returning 404 to user: Snapshot 4360605e-ea0f-44fd-a7fc-8f549499fd70 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:27.847813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7efa53cd-99f6-413f-a8b6-878723f3975f tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70" status: 404 len: 111 microversion: 2.1 time: 0.098863 May 26 17:02:27.848940 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 553/1096] 10.222.0.48 () {58 vars in 1250 bytes} [Thu May 26 17:02:27 2022] GET /compute/v2.1/os-snapshots/4360605e-ea0f-44fd-a7fc-8f549499fd70 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:02:27.855292 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9d21399f-752c-42d2-a9b6-d9b5bb3766ac tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe805d3160>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:28.405847 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9d21399f-752c-42d2-a9b6-d9b5bb3766ac tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e" status: 202 len: 0 microversion: 2.1 time: 0.555161 May 26 17:02:28.406424 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 544/1097] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 26 17:02:27 2022] DELETE /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:02:28.414560 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e40ee224-e39c-4179-af7c-3f9489aebf81 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe80459160>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:28.472290 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e40ee224-e39c-4179-af7c-3f9489aebf81 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e" status: 200 len: 345 microversion: 2.1 time: 0.061209 May 26 17:02:28.473049 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 554/1098] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 26 17:02:28 2022] GET /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:28.801093 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ca84cf22-7346-425f-b2d9-5f6e4d478205 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:28.801887 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ca84cf22-7346-425f-b2d9-5f6e4d478205 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:28.814765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca84cf22-7346-425f-b2d9-5f6e4d478205 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:28.815282 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca84cf22-7346-425f-b2d9-5f6e4d478205 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:28.816064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca84cf22-7346-425f-b2d9-5f6e4d478205 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:28.816535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca84cf22-7346-425f-b2d9-5f6e4d478205 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:28.959148 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ca84cf22-7346-425f-b2d9-5f6e4d478205 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:28.967380 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ca84cf22-7346-425f-b2d9-5f6e4d478205 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1318 microversion: 2.1 time: 0.171513 May 26 17:02:28.967943 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 545/1099] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:28 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:29.486032 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4f9d84b4-275b-41c3-a99c-d4fc0244fd58 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe805bec10>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:29.515002 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-4f9d84b4-275b-41c3-a99c-d4fc0244fd58 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] HTTP exception thrown: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4f9d84b4-275b-41c3-a99c-d4fc0244fd58 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Request method failure captured: May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e HTTP/1.1 May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7KZupEgNjjoaBYM8TJ2_bdU5Lx32CS2IKD7wu5fuqDOVCBaIliB5oxa_D3Rm2u50b7AzjXUuTGVcAgCOGyu8TVNrsJFDfSO12JKPnFOaCKrQ-AUuyt_m1i-2RI0-UcSlIh6nnx-c4pOqDqn-AbY9qMM12meGFGbFdIfWw8J_kZBKf0 May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 385f893eb30e4767a469a8279332dcf0 May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2141228092 May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:02:29.517067 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:02:29.518688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/385f893eb30e4767a469a8279332dcf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/385f893eb30e4767a469a8279332dcf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_385f893eb30e4767a469a8279332dcf0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/385f893eb30e4767a469a8279332dcf0"}]}] May 26 17:02:29.518688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2141228092 May 26 17:02:29.518688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 385f893eb30e4767a469a8279332dcf0 May 26 17:02:29.518688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2141228092 May 26 17:02:29.518688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-VolumesSnapshotsTestJSON-2141228092-project May 26 17:02:29.518688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:02:29.518688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:02:29.518688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 1186267f6b0f4f7ba4f493003aabfa77 May 26 17:02:29.518688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2141228092-project May 26 17:02:29.518688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: May 26 17:02:29.518688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. May 26 17:02:29.518688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': 'eaa79799-8a7b-4cd5-b829-b5f63ae73a0e'} May 26 17:02:29.518688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. (HTTP 404) (Request-ID: req-22b8f53a-3bf8-4ab3-9e3b-e1297faabe51) May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:29.519802 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:02:29.521215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 17:02:29.524762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:29.526195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. May 26 17:02:29.526195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:29.526195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:29.526195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:29.526195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:29.526195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:29.526195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:29.526195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:29.526195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:29.526195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. May 26 17:02:29.526195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:29.526195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4f9d84b4-275b-41c3-a99c-d4fc0244fd58 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Returning 404 to user: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:29.526195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4f9d84b4-275b-41c3-a99c-d4fc0244fd58 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e" status: 404 len: 109 microversion: 2.1 time: 0.037022 May 26 17:02:29.527466 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 555/1100] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 26 17:02:29 2022] GET /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:02:29.528442 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a3f9200d-8b6f-4c41-9251-e8112f541f47 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe805d3940>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:29.561156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-a3f9200d-8b6f-4c41-9251-e8112f541f47 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] HTTP exception thrown: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a3f9200d-8b6f-4c41-9251-e8112f541f47 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Request method failure captured: May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e HTTP/1.1 May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7KZupEgNjjoaBYM8TJ2_bdU5Lx32CS2IKD7wu5fuqDOVCBaIliB5oxa_D3Rm2u50b7AzjXUuTGVcAgCOGyu8TVNrsJFDfSO12JKPnFOaCKrQ-AUuyt_m1i-2RI0-UcSlIh6nnx-c4pOqDqn-AbY9qMM12meGFGbFdIfWw8J_kZBKf0 May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 385f893eb30e4767a469a8279332dcf0 May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2141228092 May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:02:29.570806 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:02:29.577396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/385f893eb30e4767a469a8279332dcf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/385f893eb30e4767a469a8279332dcf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_385f893eb30e4767a469a8279332dcf0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/385f893eb30e4767a469a8279332dcf0"}]}] May 26 17:02:29.577396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2141228092 May 26 17:02:29.577396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 385f893eb30e4767a469a8279332dcf0 May 26 17:02:29.577396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2141228092 May 26 17:02:29.577396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-VolumesSnapshotsTestJSON-2141228092-project May 26 17:02:29.577396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:02:29.577396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:02:29.577396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: 1186267f6b0f4f7ba4f493003aabfa77 May 26 17:02:29.577396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2141228092-project May 26 17:02:29.577396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: May 26 17:02:29.577396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. May 26 17:02:29.577396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': 'eaa79799-8a7b-4cd5-b829-b5f63ae73a0e'} May 26 17:02:29.577396 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. (HTTP 404) (Request-ID: req-3ca1c103-0a88-4b5f-82b9-b99bb72fa483) May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:29.578844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 17:02:29.580748 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 17:02:29.582859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:29.584415 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. May 26 17:02:29.584415 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:29.584415 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:29.584415 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:29.584415 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:29.584415 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:29.584415 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:29.584415 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:29.584415 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:29.584415 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. May 26 17:02:29.584415 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:29.584415 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a3f9200d-8b6f-4c41-9251-e8112f541f47 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Returning 404 to user: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:29.584415 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a3f9200d-8b6f-4c41-9251-e8112f541f47 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e" status: 404 len: 109 microversion: 2.1 time: 0.047993 May 26 17:02:29.585514 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 546/1101] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 26 17:02:29 2022] DELETE /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:02:29.586383 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-514327f3-069f-46dc-b3cf-d71a555aebf6 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Calling method '.version_select at 0x7fbe8042b310>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:29.612417 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-514327f3-069f-46dc-b3cf-d71a555aebf6 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] HTTP exception thrown: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-514327f3-069f-46dc-b3cf-d71a555aebf6 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Request method failure captured: May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e HTTP/1.1 May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7KZupEgNjjoaBYM8TJ2_bdU5Lx32CS2IKD7wu5fuqDOVCBaIliB5oxa_D3Rm2u50b7AzjXUuTGVcAgCOGyu8TVNrsJFDfSO12JKPnFOaCKrQ-AUuyt_m1i-2RI0-UcSlIh6nnx-c4pOqDqn-AbY9qMM12meGFGbFdIfWw8J_kZBKf0 May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 385f893eb30e4767a469a8279332dcf0 May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2141228092 May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:02:29.614554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:02:29.616138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/385f893eb30e4767a469a8279332dcf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/385f893eb30e4767a469a8279332dcf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_385f893eb30e4767a469a8279332dcf0", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/385f893eb30e4767a469a8279332dcf0"}]}] May 26 17:02:29.616138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2141228092 May 26 17:02:29.616138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 385f893eb30e4767a469a8279332dcf0 May 26 17:02:29.616138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2141228092 May 26 17:02:29.616138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-VolumesSnapshotsTestJSON-2141228092-project May 26 17:02:29.616138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:02:29.616138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:02:29.616138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 1186267f6b0f4f7ba4f493003aabfa77 May 26 17:02:29.616138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2141228092-project May 26 17:02:29.616138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: May 26 17:02:29.616138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. May 26 17:02:29.616138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': 'eaa79799-8a7b-4cd5-b829-b5f63ae73a0e'} May 26 17:02:29.616138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. (HTTP 404) (Request-ID: req-c8fe0620-751a-481e-a275-6975de7f9bae) May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:29.620450 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:02:29.627682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 17:02:29.629117 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:29.630540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. May 26 17:02:29.630540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:29.630540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:29.630540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:29.630540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:29.630540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:29.630540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:29.630540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:29.630540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:29.630540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. May 26 17:02:29.630540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:02:29.630540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-514327f3-069f-46dc-b3cf-d71a555aebf6 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] Returning 404 to user: Volume eaa79799-8a7b-4cd5-b829-b5f63ae73a0e could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:29.630540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-514327f3-069f-46dc-b3cf-d71a555aebf6 tempest-VolumesSnapshotsTestJSON-2141228092 tempest-VolumesSnapshotsTestJSON-2141228092-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e" status: 404 len: 109 microversion: 2.1 time: 0.037422 May 26 17:02:29.630540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 556/1102] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 26 17:02:29 2022] GET /compute/v2.1/os-volumes/eaa79799-8a7b-4cd5-b829-b5f63ae73a0e => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:02:29.985664 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ca1364d7-01cc-4d41-be35-90371b50e3da tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:29.986286 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ca1364d7-01cc-4d41-be35-90371b50e3da tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:29.993248 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca1364d7-01cc-4d41-be35-90371b50e3da tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:29.993733 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca1364d7-01cc-4d41-be35-90371b50e3da tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:29.994517 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca1364d7-01cc-4d41-be35-90371b50e3da tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:29.994963 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca1364d7-01cc-4d41-be35-90371b50e3da tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:30.139169 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-ca1364d7-01cc-4d41-be35-90371b50e3da tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:30.149379 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ca1364d7-01cc-4d41-be35-90371b50e3da tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1506 microversion: 2.1 time: 0.168644 May 26 17:02:30.150211 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 547/1103] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:29 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:30.174928 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-245ef17f-d748-4d87-b9c5-58b846af780e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87bb3ea4-130b-44f3-ae59-363d1e4caa4f", "device": "/dev/sdb"}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:30.176664 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-245ef17f-d748-4d87-b9c5-58b846af780e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:30.183149 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=56 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:30.185700 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-245ef17f-d748-4d87-b9c5-58b846af780e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:30.190358 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-245ef17f-d748-4d87-b9c5-58b846af780e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:30.190358 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-245ef17f-d748-4d87-b9c5-58b846af780e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:30.190358 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-245ef17f-d748-4d87-b9c5-58b846af780e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:31.297830 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-245ef17f-d748-4d87-b9c5-58b846af780e tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "POST /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.124407 May 26 17:02:31.297830 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 557/1104] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 26 17:02:30 2022] POST /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206/os-volume_attachments => generated 194 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:02:32.165936 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a2c166d1-cc45-436f-a0d2-04b30d525623 tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] Action: 'create', calling method: .version_select at 0x7fbe8079daf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1680096976", "metadata": {"Type": "work"}}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:32.893067 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a2c166d1-cc45-436f-a0d2-04b30d525623 tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.843979 May 26 17:02:32.893067 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 548/1105] 10.222.0.48 () {60 vars in 1155 bytes} [Thu May 26 17:02:32 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 845 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 17:02:32.896567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3c954b05-4153-45ed-9522-3600c38c0125 tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] Calling method '.version_select at 0x7fbe804591f0>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:32.953469 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3c954b05-4153-45ed-9522-3600c38c0125 tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e01a0c47-5f6d-4625-b269-ef248f25f1a3" status: 200 len: 353 microversion: 2.1 time: 0.061728 May 26 17:02:32.954055 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 558/1106] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 26 17:02:32 2022] GET /compute/v2.1/os-volumes/e01a0c47-5f6d-4625-b269-ef248f25f1a3 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:33.093837 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-366338947", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-787864708", "security_groups": [{"name": "tempest-secgroup-smoke-1078549195"}], "block_device_mapping_v2": [{"uuid": "d348cd36-bd99-4e5f-abbd-6c3ed149ef69", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3b72a37f-f6f4-40d5-aa2f-177110f74e30"}]}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:33.227873 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.network.neutron [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] validate_networks() for [('3b72a37f-f6f4-40d5-aa2f-177110f74e30', None, None, None, None, None)] {{(pid=124837) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:02:33.624680 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Flavor limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:02:33.625186 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Image limits 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:02:33.625909 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Flavor pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:02:33.626332 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Image pref 0:0:0 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:02:33.626758 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.virt.hardware [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:02:33.635946 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:33.636402 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:33.637238 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:33.637707 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:33.655951 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Getting quotas for project 895a592d480548ddb6afdb1e7c45ed92. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:02:33.659943 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Getting quotas for user 5d6ddab73db44710bcb5bba4c0cfbcfa and project 895a592d480548ddb6afdb1e7c45ed92. Resources: {'instances', 'cores', 'ram'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:02:33.722570 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Going to run 1 instances... {{(pid=124837) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:02:33.724668 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d348cd36-bd99-4e5f-abbd-6c3ed149ef69',volume_size=None,volume_type=None)] {{(pid=124837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:02:33.966948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6f2c917d-6904-419a-9b20-dadb5c7e2aa2 tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] Calling method '.version_select at 0x7fbe8034ea60>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:34.020341 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6f2c917d-6904-419a-9b20-dadb5c7e2aa2 tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e01a0c47-5f6d-4625-b269-ef248f25f1a3" status: 200 len: 354 microversion: 2.1 time: 0.057842 May 26 17:02:34.020985 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 559/1107] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 26 17:02:33 2022] GET /compute/v2.1/os-volumes/e01a0c47-5f6d-4625-b269-ef248f25f1a3 => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:34.035711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c9a6b6f1-0a9c-4ca3-98f9-8fb1f7ebdda1 tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] Calling method '.version_select at 0x7fbe804591f0>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:34.097389 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c9a6b6f1-0a9c-4ca3-98f9-8fb1f7ebdda1 tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e01a0c47-5f6d-4625-b269-ef248f25f1a3" status: 200 len: 354 microversion: 2.1 time: 0.065260 May 26 17:02:34.097984 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 560/1108] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 26 17:02:34 2022] GET /compute/v2.1/os-volumes/e01a0c47-5f6d-4625-b269-ef248f25f1a3 => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:34.114631 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6c564298-ebc8-4966-83c3-a41cfb0e1b0e tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] Calling method '.version_select at 0x7fbe804125e0>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:34.200968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-88f130a4-ca77-4af4-acf7-f420237fc4f7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.115499 May 26 17:02:34.207323 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 549/1109] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 17:02:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 17:02:34.212163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-e7217d28-2b54-4159-bd36-7ff3d98e4e87 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:34.212759 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-e7217d28-2b54-4159-bd36-7ff3d98e4e87 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:34.276980 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-e7217d28-2b54-4159-bd36-7ff3d98e4e87 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:34.284963 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-e7217d28-2b54-4159-bd36-7ff3d98e4e87 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1093 microversion: 2.1 time: 0.076710 May 26 17:02:34.285586 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 550/1110] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:34 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:34.358337 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6c564298-ebc8-4966-83c3-a41cfb0e1b0e tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/e01a0c47-5f6d-4625-b269-ef248f25f1a3" status: 202 len: 0 microversion: 2.1 time: 0.247209 May 26 17:02:34.359374 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 561/1111] 10.222.0.48 () {58 vars in 1247 bytes} [Thu May 26 17:02:34 2022] DELETE /compute/v2.1/os-volumes/e01a0c47-5f6d-4625-b269-ef248f25f1a3 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:02:34.367255 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-948b20fd-768e-490a-b855-561e1ea37899 tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] Calling method '.version_select at 0x7fbe811c1ee0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:34.416193 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-948b20fd-768e-490a-b855-561e1ea37899 tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e01a0c47-5f6d-4625-b269-ef248f25f1a3" status: 200 len: 353 microversion: 2.1 time: 0.052592 May 26 17:02:34.416778 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 551/1112] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 26 17:02:34 2022] GET /compute/v2.1/os-volumes/e01a0c47-5f6d-4625-b269-ef248f25f1a3 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:35.304893 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2264d635-c076-480b-ba3e-f90afec928a0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:35.305586 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2264d635-c076-480b-ba3e-f90afec928a0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:35.312269 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2264d635-c076-480b-ba3e-f90afec928a0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:35.312718 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2264d635-c076-480b-ba3e-f90afec928a0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:35.313521 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2264d635-c076-480b-ba3e-f90afec928a0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:35.313959 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2264d635-c076-480b-ba3e-f90afec928a0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:35.319004 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:35.385137 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2264d635-c076-480b-ba3e-f90afec928a0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:35.393126 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2264d635-c076-480b-ba3e-f90afec928a0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1143 microversion: 2.1 time: 0.092663 May 26 17:02:35.393724 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 562/1113] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:35 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1143 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:35.429464 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7ce2d048-24bf-4861-b89b-2fe714900471 tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] Calling method '.version_select at 0x7fbe8068b4c0>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:35.472184 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-7ce2d048-24bf-4861-b89b-2fe714900471 tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] HTTP exception thrown: Volume e01a0c47-5f6d-4625-b269-ef248f25f1a3 could not be found. May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7ce2d048-24bf-4861-b89b-2fe714900471 tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] Request method failure captured: May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/os-volumes/e01a0c47-5f6d-4625-b269-ef248f25f1a3 HTTP/1.1 May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7KnOWgOIfi19oaenmoYqZ5Lywa_zpecWjxpx5z7-7HKQ8k7HovLgQTDaCrSkJTohJBLhrUkiTdM4Art_Dnq5VU-dR7L1gZ8S5eR-Y-5Q37E2HF5vOFGqg1wkTqm2eguZqyXtONQeZHvsATeuEI1M0SSkd72mOxHURPKdBfyoC75PhY May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: ca1fabba58504cdba84e334bd3cf9513 May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-VolumesGetTestJSON-1110112637 May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:02:35.474188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:02:35.476157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca1fabba58504cdba84e334bd3cf9513"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ca1fabba58504cdba84e334bd3cf9513"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ca1fabba58504cdba84e334bd3cf9513", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ca1fabba58504cdba84e334bd3cf9513"}]}] May 26 17:02:35.476157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-VolumesGetTestJSON-1110112637 May 26 17:02:35.476157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: ca1fabba58504cdba84e334bd3cf9513 May 26 17:02:35.476157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-VolumesGetTestJSON-1110112637 May 26 17:02:35.476157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-VolumesGetTestJSON-1110112637-project May 26 17:02:35.476157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:02:35.476157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:02:35.476157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: ac6e4dc226994688988e278c8df86467 May 26 17:02:35.476157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-VolumesGetTestJSON-1110112637-project May 26 17:02:35.476157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: May 26 17:02:35.476157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Volume e01a0c47-5f6d-4625-b269-ef248f25f1a3 could not be found. May 26 17:02:35.476157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': 'e01a0c47-5f6d-4625-b269-ef248f25f1a3'} May 26 17:02:35.476157 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e01a0c47-5f6d-4625-b269-ef248f25f1a3 could not be found. (HTTP 404) (Request-ID: req-50181273-b1a4-4c20-b054-22004811a17c) May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:35.477163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 17:02:35.483368 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e01a0c47-5f6d-4625-b269-ef248f25f1a3 could not be found. May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 17:02:35.485433 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:02:35.486849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e01a0c47-5f6d-4625-b269-ef248f25f1a3 could not be found. May 26 17:02:35.486849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:35.486849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:02:35.486849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:35.486849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:02:35.486849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:02:35.486849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:02:35.486849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:02:35.486849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:02:35.486849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e01a0c47-5f6d-4625-b269-ef248f25f1a3 could not be found. May 26 17:02:35.486849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:02:35.486849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7ce2d048-24bf-4861-b89b-2fe714900471 tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] Returning 404 to user: Volume e01a0c47-5f6d-4625-b269-ef248f25f1a3 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:02:35.486849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7ce2d048-24bf-4861-b89b-2fe714900471 tempest-VolumesGetTestJSON-1110112637 tempest-VolumesGetTestJSON-1110112637-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e01a0c47-5f6d-4625-b269-ef248f25f1a3" status: 404 len: 109 microversion: 2.1 time: 0.051849 May 26 17:02:35.486849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 552/1114] 10.222.0.48 () {58 vars in 1244 bytes} [Thu May 26 17:02:35 2022] GET /compute/v2.1/os-volumes/e01a0c47-5f6d-4625-b269-ef248f25f1a3 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:02:36.410781 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1f2bce97-1353-40d4-9d3f-7000b49d5855 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:36.411407 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1f2bce97-1353-40d4-9d3f-7000b49d5855 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:36.418540 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1f2bce97-1353-40d4-9d3f-7000b49d5855 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:36.418993 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1f2bce97-1353-40d4-9d3f-7000b49d5855 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:36.419770 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1f2bce97-1353-40d4-9d3f-7000b49d5855 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:36.420268 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1f2bce97-1353-40d4-9d3f-7000b49d5855 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:36.491202 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1f2bce97-1353-40d4-9d3f-7000b49d5855 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:36.498837 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-1f2bce97-1353-40d4-9d3f-7000b49d5855 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1191 microversion: 2.1 time: 0.091907 May 26 17:02:36.499943 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 563/1115] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:36 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1191 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:37.518073 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f4effd50-7c08-45e7-8b25-27fea8ad7cf9 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:37.518704 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f4effd50-7c08-45e7-8b25-27fea8ad7cf9 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:37.524910 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4effd50-7c08-45e7-8b25-27fea8ad7cf9 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:37.525403 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4effd50-7c08-45e7-8b25-27fea8ad7cf9 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:37.526189 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4effd50-7c08-45e7-8b25-27fea8ad7cf9 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:37.526628 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f4effd50-7c08-45e7-8b25-27fea8ad7cf9 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:37.530884 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=87 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:37.594977 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f4effd50-7c08-45e7-8b25-27fea8ad7cf9 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:37.603996 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f4effd50-7c08-45e7-8b25-27fea8ad7cf9 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1209 microversion: 2.1 time: 0.090368 May 26 17:02:37.604766 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 553/1116] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:37 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:38.630307 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-126df48b-382a-4927-b6f1-e76a7801c2da tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:38.631686 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-126df48b-382a-4927-b6f1-e76a7801c2da tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:38.638517 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-126df48b-382a-4927-b6f1-e76a7801c2da tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:38.638971 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-126df48b-382a-4927-b6f1-e76a7801c2da tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:38.639786 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-126df48b-382a-4927-b6f1-e76a7801c2da tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:38.640190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-126df48b-382a-4927-b6f1-e76a7801c2da tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:38.839635 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-126df48b-382a-4927-b6f1-e76a7801c2da tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:38.847877 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-126df48b-382a-4927-b6f1-e76a7801c2da tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1277 microversion: 2.1 time: 0.223563 May 26 17:02:38.848545 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 564/1117] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:38 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1277 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:39.448247 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-ef987360-b05b-4fa2-b5aa-897b5d84c92a req-690676b7-23c9-4183-a345-b87c65f5c64d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7892d0ad-12f2-4fd6-ab09-771e48e98dd2", "tag": "6a11e212-e4cf-4d6b-95e6-04b99b515738"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:39.487405 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-ef987360-b05b-4fa2-b5aa-897b5d84c92a req-690676b7-23c9-4183-a345-b87c65f5c64d service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:39.487881 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-ef987360-b05b-4fa2-b5aa-897b5d84c92a req-690676b7-23c9-4183-a345-b87c65f5c64d service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:39.519733 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-ef987360-b05b-4fa2-b5aa-897b5d84c92a req-690676b7-23c9-4183-a345-b87c65f5c64d service nova] Creating event network-changed:6a11e212-e4cf-4d6b-95e6-04b99b515738 for instance 7892d0ad-12f2-4fd6-ab09-771e48e98dd2 on hv-cinder-83607 May 26 17:02:39.534485 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-ef987360-b05b-4fa2-b5aa-897b5d84c92a req-690676b7-23c9-4183-a345-b87c65f5c64d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085844 May 26 17:02:39.534485 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 554/1118] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:39.867292 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8f669587-6f79-4a18-a7bd-e74700e9712f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:39.867921 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8f669587-6f79-4a18-a7bd-e74700e9712f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:39.878999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8f669587-6f79-4a18-a7bd-e74700e9712f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:39.879464 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8f669587-6f79-4a18-a7bd-e74700e9712f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:39.880299 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8f669587-6f79-4a18-a7bd-e74700e9712f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:39.880739 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8f669587-6f79-4a18-a7bd-e74700e9712f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:40.043969 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8f669587-6f79-4a18-a7bd-e74700e9712f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:40.051437 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8f669587-6f79-4a18-a7bd-e74700e9712f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1277 microversion: 2.1 time: 0.189833 May 26 17:02:40.051998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 565/1119] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:39 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:41.074993 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9a3ca3b5-6086-4bab-83cd-9daaefbc4000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:41.075796 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9a3ca3b5-6086-4bab-83cd-9daaefbc4000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:41.082323 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a3ca3b5-6086-4bab-83cd-9daaefbc4000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:41.082787 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a3ca3b5-6086-4bab-83cd-9daaefbc4000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:41.083555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a3ca3b5-6086-4bab-83cd-9daaefbc4000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:41.084002 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a3ca3b5-6086-4bab-83cd-9daaefbc4000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:41.220278 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9a3ca3b5-6086-4bab-83cd-9daaefbc4000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:41.229624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9a3ca3b5-6086-4bab-83cd-9daaefbc4000 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1277 microversion: 2.1 time: 0.165144 May 26 17:02:41.230295 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 555/1120] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:41 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:42.246625 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6314da3d-9608-48d3-9f24-6eb2d74f1aca tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:42.247181 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6314da3d-9608-48d3-9f24-6eb2d74f1aca tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:42.254302 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6314da3d-9608-48d3-9f24-6eb2d74f1aca tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:42.261689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6314da3d-9608-48d3-9f24-6eb2d74f1aca tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:42.261689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6314da3d-9608-48d3-9f24-6eb2d74f1aca tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:42.261689 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6314da3d-9608-48d3-9f24-6eb2d74f1aca tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:42.398645 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6314da3d-9608-48d3-9f24-6eb2d74f1aca tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:42.406749 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6314da3d-9608-48d3-9f24-6eb2d74f1aca tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1265 microversion: 2.1 time: 0.164363 May 26 17:02:42.407758 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 566/1121] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:42 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:43.423974 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-326bf28a-458e-401c-aabb-0a740286567c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:43.424781 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-326bf28a-458e-401c-aabb-0a740286567c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:43.432055 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-326bf28a-458e-401c-aabb-0a740286567c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:43.432536 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-326bf28a-458e-401c-aabb-0a740286567c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:43.434084 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-326bf28a-458e-401c-aabb-0a740286567c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:43.434535 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-326bf28a-458e-401c-aabb-0a740286567c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:43.616663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-326bf28a-458e-401c-aabb-0a740286567c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:43.624277 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-326bf28a-458e-401c-aabb-0a740286567c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1265 microversion: 2.1 time: 0.204111 May 26 17:02:43.624844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 556/1122] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:43 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:44.642101 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-33d22686-fd79-43b9-b714-7d9779c1537a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:44.643271 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-33d22686-fd79-43b9-b714-7d9779c1537a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:44.650103 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-33d22686-fd79-43b9-b714-7d9779c1537a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:44.650568 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-33d22686-fd79-43b9-b714-7d9779c1537a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:44.651346 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-33d22686-fd79-43b9-b714-7d9779c1537a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:44.651798 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-33d22686-fd79-43b9-b714-7d9779c1537a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:44.796078 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-33d22686-fd79-43b9-b714-7d9779c1537a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:44.804122 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-33d22686-fd79-43b9-b714-7d9779c1537a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1265 microversion: 2.1 time: 0.165843 May 26 17:02:44.804713 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 567/1123] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:44 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:45.821097 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c3d5a755-c370-4f04-aabf-66ef39a264db tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:45.821742 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c3d5a755-c370-4f04-aabf-66ef39a264db tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:45.823899 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:45.824602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=8 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:45.830998 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c3d5a755-c370-4f04-aabf-66ef39a264db tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:45.832010 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c3d5a755-c370-4f04-aabf-66ef39a264db tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:45.833086 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c3d5a755-c370-4f04-aabf-66ef39a264db tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:45.833562 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c3d5a755-c370-4f04-aabf-66ef39a264db tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:45.972524 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c3d5a755-c370-4f04-aabf-66ef39a264db tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:45.978082 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c3d5a755-c370-4f04-aabf-66ef39a264db tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1265 microversion: 2.1 time: 0.160753 May 26 17:02:45.978664 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 557/1124] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:45 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:46.995813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-bfb331c6-3726-4aab-8f30-07a67a6e7790 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:46.996691 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-bfb331c6-3726-4aab-8f30-07a67a6e7790 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:47.004058 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bfb331c6-3726-4aab-8f30-07a67a6e7790 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:47.004523 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bfb331c6-3726-4aab-8f30-07a67a6e7790 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:47.005314 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bfb331c6-3726-4aab-8f30-07a67a6e7790 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:47.005762 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bfb331c6-3726-4aab-8f30-07a67a6e7790 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:47.164887 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-bfb331c6-3726-4aab-8f30-07a67a6e7790 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:47.172687 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-bfb331c6-3726-4aab-8f30-07a67a6e7790 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1265 microversion: 2.1 time: 0.180768 May 26 17:02:47.173276 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 568/1125] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:46 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:48.190822 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f7b9b98b-69ef-4b62-95e5-14cbdb9afd0c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:48.191984 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f7b9b98b-69ef-4b62-95e5-14cbdb9afd0c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:48.209411 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7b9b98b-69ef-4b62-95e5-14cbdb9afd0c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:48.209868 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7b9b98b-69ef-4b62-95e5-14cbdb9afd0c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:48.210638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7b9b98b-69ef-4b62-95e5-14cbdb9afd0c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:48.211322 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7b9b98b-69ef-4b62-95e5-14cbdb9afd0c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:48.351344 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f7b9b98b-69ef-4b62-95e5-14cbdb9afd0c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:48.358873 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f7b9b98b-69ef-4b62-95e5-14cbdb9afd0c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1265 microversion: 2.1 time: 0.172679 May 26 17:02:48.359449 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 558/1126] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:48 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:49.375799 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-d3a4fbc2-0186-4366-8c7b-ecdc90fddda6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:49.376421 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-d3a4fbc2-0186-4366-8c7b-ecdc90fddda6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:49.383707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d3a4fbc2-0186-4366-8c7b-ecdc90fddda6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:49.384168 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d3a4fbc2-0186-4366-8c7b-ecdc90fddda6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:49.384947 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d3a4fbc2-0186-4366-8c7b-ecdc90fddda6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:49.385435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-d3a4fbc2-0186-4366-8c7b-ecdc90fddda6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:49.532813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-d3a4fbc2-0186-4366-8c7b-ecdc90fddda6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:49.540659 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-d3a4fbc2-0186-4366-8c7b-ecdc90fddda6 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1265 microversion: 2.1 time: 0.168775 May 26 17:02:49.541340 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 569/1127] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:49 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:50.557669 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fd406d40-8a6c-4977-8ef9-7a31fde53f75 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:50.558333 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fd406d40-8a6c-4977-8ef9-7a31fde53f75 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:50.565859 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fd406d40-8a6c-4977-8ef9-7a31fde53f75 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:50.566401 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fd406d40-8a6c-4977-8ef9-7a31fde53f75 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:50.567144 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fd406d40-8a6c-4977-8ef9-7a31fde53f75 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:50.567577 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fd406d40-8a6c-4977-8ef9-7a31fde53f75 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:50.710154 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-fd406d40-8a6c-4977-8ef9-7a31fde53f75 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:50.717985 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fd406d40-8a6c-4977-8ef9-7a31fde53f75 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1265 microversion: 2.1 time: 0.164140 May 26 17:02:50.725436 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 559/1128] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:50 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:51.738424 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e5ed8f52-95ae-4776-81ba-8ef1f48c94a8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:51.739062 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e5ed8f52-95ae-4776-81ba-8ef1f48c94a8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:51.746020 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5ed8f52-95ae-4776-81ba-8ef1f48c94a8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:51.746489 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5ed8f52-95ae-4776-81ba-8ef1f48c94a8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:51.747266 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5ed8f52-95ae-4776-81ba-8ef1f48c94a8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:51.747714 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e5ed8f52-95ae-4776-81ba-8ef1f48c94a8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:51.883421 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e5ed8f52-95ae-4776-81ba-8ef1f48c94a8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:51.891954 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e5ed8f52-95ae-4776-81ba-8ef1f48c94a8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1265 microversion: 2.1 time: 0.157357 May 26 17:02:51.892521 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 570/1129] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:51 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:52.910283 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-602fa18e-be41-46c1-9a7f-2e769a4b4766 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:52.911554 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-602fa18e-be41-46c1-9a7f-2e769a4b4766 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:52.918163 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-602fa18e-be41-46c1-9a7f-2e769a4b4766 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:52.918947 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-602fa18e-be41-46c1-9a7f-2e769a4b4766 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:52.919830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-602fa18e-be41-46c1-9a7f-2e769a4b4766 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:52.920340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-602fa18e-be41-46c1-9a7f-2e769a4b4766 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:53.002741 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1741111972", "imageRef": "202b3c5f-a900-44fe-946f-2ea4560e3140", "flavorRef": "452"}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:53.059776 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.network.neutron [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] validate_networks() for None {{(pid=124836) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:02:53.069335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-602fa18e-be41-46c1-9a7f-2e769a4b4766 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:53.078149 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-602fa18e-be41-46c1-9a7f-2e769a4b4766 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1265 microversion: 2.1 time: 0.172899 May 26 17:02:53.079297 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 560/1130] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:52 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:53.583274 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Flavor limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:02:53.583708 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Image limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:02:53.584193 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Flavor pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:02:53.584612 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Image pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:02:53.585032 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:02:53.598965 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:53.598965 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:53.598965 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:53.598965 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:53.614119 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Getting quotas for project 5709ce2fac32449a929d5a4064fdd532. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:02:53.618178 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Getting quotas for user fd4ebe90383349929464a3dca691b92b and project 5709ce2fac32449a929d5a4064fdd532. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:02:53.630425 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Going to run 1 instances... {{(pid=124836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:02:53.632744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='202b3c5f-a900-44fe-946f-2ea4560e3140',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:02:53.775902 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c37365f1-f243-493e-a1bb-86d17807d7a2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:53.776413 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c37365f1-f243-493e-a1bb-86d17807d7a2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:53.782463 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c37365f1-f243-493e-a1bb-86d17807d7a2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:53.782915 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c37365f1-f243-493e-a1bb-86d17807d7a2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:53.783684 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c37365f1-f243-493e-a1bb-86d17807d7a2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:53.784123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c37365f1-f243-493e-a1bb-86d17807d7a2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:53.809061 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6aa9532a-0d9b-4a23-a7c7-08d91d64c112 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809927 May 26 17:02:53.814875 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 571/1131] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 17:02:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 17:02:53.827336 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3009ed31-34a3-4f23-bd4b-ff78981dec5c tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:53.827970 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3009ed31-34a3-4f23-bd4b-ff78981dec5c tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:53.882188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-c37365f1-f243-493e-a1bb-86d17807d7a2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lazy-loading 'services' on Instance uuid f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:02:53.896828 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3009ed31-34a3-4f23-bd4b-ff78981dec5c tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:53.904636 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3009ed31-34a3-4f23-bd4b-ff78981dec5c tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1215 microversion: 2.1 time: 0.088568 May 26 17:02:53.905289 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 572/1132] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:53 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:54.099464 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-2bb0656b-e219-4ee4-9b4e-e53326749c5a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:54.100498 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-2bb0656b-e219-4ee4-9b4e-e53326749c5a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:54.107929 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2bb0656b-e219-4ee4-9b4e-e53326749c5a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:54.108469 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2bb0656b-e219-4ee4-9b4e-e53326749c5a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:54.109244 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2bb0656b-e219-4ee4-9b4e-e53326749c5a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:54.109712 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-2bb0656b-e219-4ee4-9b4e-e53326749c5a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:54.239693 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c37365f1-f243-493e-a1bb-86d17807d7a2 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206/os-volume_attachments/87bb3ea4-130b-44f3-ae59-363d1e4caa4f" status: 202 len: 0 microversion: 2.1 time: 0.467129 May 26 17:02:54.240683 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 561/1133] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 26 17:02:53 2022] DELETE /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206/os-volume_attachments/87bb3ea4-130b-44f3-ae59-363d1e4caa4f => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:02:54.289367 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-2bb0656b-e219-4ee4-9b4e-e53326749c5a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:54.298926 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-2bb0656b-e219-4ee4-9b4e-e53326749c5a tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1265 microversion: 2.1 time: 0.203965 May 26 17:02:54.301190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 573/1134] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:54 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:54.923793 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b6ab206a-5230-4534-8570-aef1a346fe49 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:54.924664 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b6ab206a-5230-4534-8570-aef1a346fe49 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:54.928383 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:54.982265 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b6ab206a-5230-4534-8570-aef1a346fe49 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:54.989804 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b6ab206a-5230-4534-8570-aef1a346fe49 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1215 microversion: 2.1 time: 0.070422 May 26 17:02:54.990374 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 562/1135] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:54 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:55.317486 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-da68c9b8-2588-49be-8527-239462473cf2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:55.323443 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-da68c9b8-2588-49be-8527-239462473cf2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:55.326525 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-da68c9b8-2588-49be-8527-239462473cf2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:55.326987 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-da68c9b8-2588-49be-8527-239462473cf2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:55.327765 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-da68c9b8-2588-49be-8527-239462473cf2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:55.328205 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-da68c9b8-2588-49be-8527-239462473cf2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:55.466596 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-da68c9b8-2588-49be-8527-239462473cf2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:55.475204 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-da68c9b8-2588-49be-8527-239462473cf2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1265 microversion: 2.1 time: 0.161440 May 26 17:02:55.475736 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 574/1136] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:55 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:55.946281 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-9816cdac-25a9-4e45-95f8-bce5acde7485 req-62a21f89-fbb5-4bd5-81bd-c84744abc274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7892d0ad-12f2-4fd6-ab09-771e48e98dd2", "name": "network-vif-plugged", "status": "completed", "tag": "6a11e212-e4cf-4d6b-95e6-04b99b515738"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:02:55.957399 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-9816cdac-25a9-4e45-95f8-bce5acde7485 req-62a21f89-fbb5-4bd5-81bd-c84744abc274 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:55.957854 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-9816cdac-25a9-4e45-95f8-bce5acde7485 req-62a21f89-fbb5-4bd5-81bd-c84744abc274 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:55.968713 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-9816cdac-25a9-4e45-95f8-bce5acde7485 req-62a21f89-fbb5-4bd5-81bd-c84744abc274 service nova] Creating event network-vif-plugged:6a11e212-e4cf-4d6b-95e6-04b99b515738 for instance 7892d0ad-12f2-4fd6-ab09-771e48e98dd2 on hv-cinder-83607 May 26 17:02:55.973529 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-9816cdac-25a9-4e45-95f8-bce5acde7485 req-62a21f89-fbb5-4bd5-81bd-c84744abc274 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033679 May 26 17:02:55.974124 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 563/1137] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:02:56.007260 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e8feec2f-10e8-4fc0-bfbc-6aeda207ace4 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:56.007911 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e8feec2f-10e8-4fc0-bfbc-6aeda207ace4 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:56.014130 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e8feec2f-10e8-4fc0-bfbc-6aeda207ace4 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:56.014588 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e8feec2f-10e8-4fc0-bfbc-6aeda207ace4 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:56.019281 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e8feec2f-10e8-4fc0-bfbc-6aeda207ace4 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:56.019281 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e8feec2f-10e8-4fc0-bfbc-6aeda207ace4 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:56.086804 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-e8feec2f-10e8-4fc0-bfbc-6aeda207ace4 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:56.094472 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e8feec2f-10e8-4fc0-bfbc-6aeda207ace4 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1219 microversion: 2.1 time: 0.091777 May 26 17:02:56.095036 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 575/1138] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:56 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:56.431047 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3d13b92a-a365-4561-9e13-c6384247f2af tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:56.431789 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3d13b92a-a365-4561-9e13-c6384247f2af tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:56.437958 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3d13b92a-a365-4561-9e13-c6384247f2af tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:56.438418 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3d13b92a-a365-4561-9e13-c6384247f2af tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:56.439185 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3d13b92a-a365-4561-9e13-c6384247f2af tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:56.439644 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3d13b92a-a365-4561-9e13-c6384247f2af tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:56.472772 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3d13b92a-a365-4561-9e13-c6384247f2af tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:02:56.493422 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7f860847-f027-4fa0-b9e0-bfb72829568d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:56.494844 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7f860847-f027-4fa0-b9e0-bfb72829568d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:56.505700 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7f860847-f027-4fa0-b9e0-bfb72829568d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:56.506271 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7f860847-f027-4fa0-b9e0-bfb72829568d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:56.507311 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7f860847-f027-4fa0-b9e0-bfb72829568d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:56.507998 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7f860847-f027-4fa0-b9e0-bfb72829568d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:56.641608 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7f860847-f027-4fa0-b9e0-bfb72829568d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:56.649714 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7f860847-f027-4fa0-b9e0-bfb72829568d tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1265 microversion: 2.1 time: 0.160278 May 26 17:02:56.650283 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 576/1139] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:56 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:56.828183 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3d13b92a-a365-4561-9e13-c6384247f2af tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 204 len: 0 microversion: 2.1 time: 0.400995 May 26 17:02:56.828772 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 564/1140] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:02:56 2022] DELETE /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:02:56.837546 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-eaeb3b4a-e1d6-4961-b840-3cff9c4741b9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:56.838195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-eaeb3b4a-e1d6-4961-b840-3cff9c4741b9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:56.844205 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eaeb3b4a-e1d6-4961-b840-3cff9c4741b9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:56.844664 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eaeb3b4a-e1d6-4961-b840-3cff9c4741b9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:56.845475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eaeb3b4a-e1d6-4961-b840-3cff9c4741b9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:56.845920 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-eaeb3b4a-e1d6-4961-b840-3cff9c4741b9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:56.984685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-eaeb3b4a-e1d6-4961-b840-3cff9c4741b9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:56.992412 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-eaeb3b4a-e1d6-4961-b840-3cff9c4741b9 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1512 microversion: 2.1 time: 0.158692 May 26 17:02:56.992988 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 577/1141] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:56 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:57.111892 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d9bad4cd-c289-4927-b58a-3a138b7ba714 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:57.113295 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d9bad4cd-c289-4927-b58a-3a138b7ba714 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:57.120291 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d9bad4cd-c289-4927-b58a-3a138b7ba714 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:57.121906 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d9bad4cd-c289-4927-b58a-3a138b7ba714 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:57.123276 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d9bad4cd-c289-4927-b58a-3a138b7ba714 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:57.123814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d9bad4cd-c289-4927-b58a-3a138b7ba714 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:57.200556 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d9bad4cd-c289-4927-b58a-3a138b7ba714 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:57.209063 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d9bad4cd-c289-4927-b58a-3a138b7ba714 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1267 microversion: 2.1 time: 0.101568 May 26 17:02:57.211857 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 565/1142] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:57 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1267 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:57.666674 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-885e4b78-827b-4d0c-8636-b88bdfe10601 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:57.667268 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-885e4b78-827b-4d0c-8636-b88bdfe10601 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:57.673813 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-885e4b78-827b-4d0c-8636-b88bdfe10601 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:57.674263 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-885e4b78-827b-4d0c-8636-b88bdfe10601 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:57.675638 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-885e4b78-827b-4d0c-8636-b88bdfe10601 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:57.676073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-885e4b78-827b-4d0c-8636-b88bdfe10601 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:57.810940 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-885e4b78-827b-4d0c-8636-b88bdfe10601 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:57.818949 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-885e4b78-827b-4d0c-8636-b88bdfe10601 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1265 microversion: 2.1 time: 0.156134 May 26 17:02:57.819690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 578/1143] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:57 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:58.011097 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-12f7c079-2a18-4f1f-9d3c-f24b72cda737 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:58.014804 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-12f7c079-2a18-4f1f-9d3c-f24b72cda737 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:58.019011 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-12f7c079-2a18-4f1f-9d3c-f24b72cda737 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:58.019472 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-12f7c079-2a18-4f1f-9d3c-f24b72cda737 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:58.020331 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-12f7c079-2a18-4f1f-9d3c-f24b72cda737 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:58.020780 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-12f7c079-2a18-4f1f-9d3c-f24b72cda737 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:58.155844 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-12f7c079-2a18-4f1f-9d3c-f24b72cda737 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:58.164145 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-12f7c079-2a18-4f1f-9d3c-f24b72cda737 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1512 microversion: 2.1 time: 0.157786 May 26 17:02:58.164718 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 566/1144] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:58 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:58.227700 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-91babf94-ce62-495f-8106-d4bd85fc89fa tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:58.231134 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-91babf94-ce62-495f-8106-d4bd85fc89fa tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:58.234567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-91babf94-ce62-495f-8106-d4bd85fc89fa tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:58.235457 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-91babf94-ce62-495f-8106-d4bd85fc89fa tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:58.235799 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-91babf94-ce62-495f-8106-d4bd85fc89fa tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:58.236270 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-91babf94-ce62-495f-8106-d4bd85fc89fa tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:58.297770 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-91babf94-ce62-495f-8106-d4bd85fc89fa tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:58.305435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-91babf94-ce62-495f-8106-d4bd85fc89fa tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1267 microversion: 2.1 time: 0.081947 May 26 17:02:58.306002 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 579/1145] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:58 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:02:58.836561 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bfd3e175-6c89-4784-8989-0abce9011e71 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:58.837085 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bfd3e175-6c89-4784-8989-0abce9011e71 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:58.843278 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bfd3e175-6c89-4784-8989-0abce9011e71 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:58.843735 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bfd3e175-6c89-4784-8989-0abce9011e71 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:58.844503 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bfd3e175-6c89-4784-8989-0abce9011e71 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:58.844945 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bfd3e175-6c89-4784-8989-0abce9011e71 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:58.977724 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bfd3e175-6c89-4784-8989-0abce9011e71 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:58.985315 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bfd3e175-6c89-4784-8989-0abce9011e71 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1265 microversion: 2.1 time: 0.152773 May 26 17:02:58.985995 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 567/1146] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:58 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:59.181191 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-506c65f7-e5dc-446c-a6cd-9f3f371fc454 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:59.181758 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-506c65f7-e5dc-446c-a6cd-9f3f371fc454 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:59.188212 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-506c65f7-e5dc-446c-a6cd-9f3f371fc454 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:59.188651 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-506c65f7-e5dc-446c-a6cd-9f3f371fc454 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:59.189430 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-506c65f7-e5dc-446c-a6cd-9f3f371fc454 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:59.189865 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-506c65f7-e5dc-446c-a6cd-9f3f371fc454 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:59.207498 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=100 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:59.322492 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-edd0c5b7-2152-4c60-9e64-3e17905ab2d1 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:02:59.323909 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-edd0c5b7-2152-4c60-9e64-3e17905ab2d1 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:02:59.325495 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-506c65f7-e5dc-446c-a6cd-9f3f371fc454 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:59.330695 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-edd0c5b7-2152-4c60-9e64-3e17905ab2d1 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:59.331147 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-edd0c5b7-2152-4c60-9e64-3e17905ab2d1 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:59.332621 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-edd0c5b7-2152-4c60-9e64-3e17905ab2d1 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:02:59.333063 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-edd0c5b7-2152-4c60-9e64-3e17905ab2d1 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:02:59.334048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-506c65f7-e5dc-446c-a6cd-9f3f371fc454 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1512 microversion: 2.1 time: 0.156810 May 26 17:02:59.334646 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 580/1147] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:59 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:02:59.397025 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-edd0c5b7-2152-4c60-9e64-3e17905ab2d1 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:02:59.404567 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-edd0c5b7-2152-4c60-9e64-3e17905ab2d1 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1275 microversion: 2.1 time: 0.086038 May 26 17:02:59.405134 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 568/1148] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:59 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:00.005186 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6f54877b-bb77-4831-88d2-3575e64e4c01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:00.005965 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6f54877b-bb77-4831-88d2-3575e64e4c01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:00.012284 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6f54877b-bb77-4831-88d2-3575e64e4c01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:00.012950 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6f54877b-bb77-4831-88d2-3575e64e4c01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:00.013599 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6f54877b-bb77-4831-88d2-3575e64e4c01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:00.014079 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6f54877b-bb77-4831-88d2-3575e64e4c01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:00.147667 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-6f54877b-bb77-4831-88d2-3575e64e4c01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:00.155435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6f54877b-bb77-4831-88d2-3575e64e4c01 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1451 microversion: 2.1 time: 0.154840 May 26 17:03:00.162095 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 581/1149] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:02:59 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:00.173427 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d8f792ff-0107-4c2a-9178-e5d1764da034 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:00.174047 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d8f792ff-0107-4c2a-9178-e5d1764da034 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:00.180432 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d8f792ff-0107-4c2a-9178-e5d1764da034 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:00.180744 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d8f792ff-0107-4c2a-9178-e5d1764da034 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:00.181834 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d8f792ff-0107-4c2a-9178-e5d1764da034 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:00.182436 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d8f792ff-0107-4c2a-9178-e5d1764da034 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:00.351175 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-492d90ff-e4f3-4367-aced-f62b438b15b8 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:00.351783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-492d90ff-e4f3-4367-aced-f62b438b15b8 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:00.353871 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d8f792ff-0107-4c2a-9178-e5d1764da034 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:00.354334 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:00.358749 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:00.359016 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-492d90ff-e4f3-4367-aced-f62b438b15b8 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:00.359668 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-492d90ff-e4f3-4367-aced-f62b438b15b8 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:00.360627 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-492d90ff-e4f3-4367-aced-f62b438b15b8 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:00.361229 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-492d90ff-e4f3-4367-aced-f62b438b15b8 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:00.367605 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d8f792ff-0107-4c2a-9178-e5d1764da034 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1451 microversion: 2.1 time: 0.197548 May 26 17:03:00.380374 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 569/1150] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:00 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1451 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:00.423170 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-67682785-c01f-4d3a-9628-1c4c726bdf11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:00.424493 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-67682785-c01f-4d3a-9628-1c4c726bdf11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:00.434294 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67682785-c01f-4d3a-9628-1c4c726bdf11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:00.435008 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67682785-c01f-4d3a-9628-1c4c726bdf11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:00.435986 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67682785-c01f-4d3a-9628-1c4c726bdf11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:00.436887 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-67682785-c01f-4d3a-9628-1c4c726bdf11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:00.546000 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-67682785-c01f-4d3a-9628-1c4c726bdf11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:00.554983 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-67682785-c01f-4d3a-9628-1c4c726bdf11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1273 microversion: 2.1 time: 0.137307 May 26 17:03:00.564829 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-492d90ff-e4f3-4367-aced-f62b438b15b8 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:00.565201 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 570/1151] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:00 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1273 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:03:00.572944 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-492d90ff-e4f3-4367-aced-f62b438b15b8 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1512 microversion: 2.1 time: 0.226382 May 26 17:03:00.573634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 582/1152] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:00 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1512 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:03:00.892443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-46a9ada0-6340-4596-9a7d-5b7f8040fea2 req-a109a7c0-4ba4-49d7-a78d-0ae9880e98d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206", "name": "network-vif-deleted", "tag": "a7c57a24-10c9-4532-8724-446c0b104bfc"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:00.908783 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-46a9ada0-6340-4596-9a7d-5b7f8040fea2 req-a109a7c0-4ba4-49d7-a78d-0ae9880e98d3 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:00.909602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-46a9ada0-6340-4596-9a7d-5b7f8040fea2 req-a109a7c0-4ba4-49d7-a78d-0ae9880e98d3 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:00.926325 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-46a9ada0-6340-4596-9a7d-5b7f8040fea2 req-a109a7c0-4ba4-49d7-a78d-0ae9880e98d3 service nova] Creating event network-vif-deleted:a7c57a24-10c9-4532-8724-446c0b104bfc for instance f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 on hv-cinder-83607 May 26 17:03:00.931385 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-46a9ada0-6340-4596-9a7d-5b7f8040fea2 req-a109a7c0-4ba4-49d7-a78d-0ae9880e98d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046602 May 26 17:03:00.932088 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 571/1153] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:03:01.572821 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4c305e6c-c296-47d3-a784-a9d8077397df tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:01.573468 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4c305e6c-c296-47d3-a784-a9d8077397df tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:01.586620 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4c305e6c-c296-47d3-a784-a9d8077397df tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:01.590285 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4c305e6c-c296-47d3-a784-a9d8077397df tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:01.590285 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4c305e6c-c296-47d3-a784-a9d8077397df tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:01.590285 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4c305e6c-c296-47d3-a784-a9d8077397df tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:01.592801 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2f12bd1e-524c-469f-a128-b3cec79fb0ae tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:01.593689 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2f12bd1e-524c-469f-a128-b3cec79fb0ae tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:01.602807 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2f12bd1e-524c-469f-a128-b3cec79fb0ae tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:01.603263 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2f12bd1e-524c-469f-a128-b3cec79fb0ae tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:01.605228 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2f12bd1e-524c-469f-a128-b3cec79fb0ae tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:01.605710 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2f12bd1e-524c-469f-a128-b3cec79fb0ae tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:01.642716 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2f12bd1e-524c-469f-a128-b3cec79fb0ae tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:01.643176 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2f12bd1e-524c-469f-a128-b3cec79fb0ae tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:01.643643 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-2f12bd1e-524c-469f-a128-b3cec79fb0ae tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lazy-loading 'fault' on Instance uuid f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:03:01.714757 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2f12bd1e-524c-469f-a128-b3cec79fb0ae tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '284df7837ac84a98992207ac01587020', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6ad6af479db4e92933ac0d1567f25e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:01.727114 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2f12bd1e-524c-469f-a128-b3cec79fb0ae tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 200 len: 1308 microversion: 2.1 time: 0.140228 May 26 17:03:01.727704 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 572/1154] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:01 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 1308 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:01.827816 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4c305e6c-c296-47d3-a784-a9d8077397df tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:01.836644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4c305e6c-c296-47d3-a784-a9d8077397df tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1315 microversion: 2.1 time: 0.267867 May 26 17:03:01.846355 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 583/1155] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:01 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:02.745785 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fbaaec14-367a-4276-be08-093593ebc100 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:02.747068 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-fbaaec14-367a-4276-be08-093593ebc100 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] [instance: f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:02.755382 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fbaaec14-367a-4276-be08-093593ebc100 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:02.756195 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fbaaec14-367a-4276-be08-093593ebc100 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:02.757828 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fbaaec14-367a-4276-be08-093593ebc100 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:02.758495 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-fbaaec14-367a-4276-be08-093593ebc100 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:02.774825 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-fbaaec14-367a-4276-be08-093593ebc100 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] HTTP exception thrown: Instance f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 could not be found. May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fbaaec14-367a-4276-be08-093593ebc100 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Request method failure captured: May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 HTTP/1.1 May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7Iupz17gQ__uHiLWU2lP8HQgqs2_ZS41vTIycvwzValcJ2f4B_0ITjkvtrg_bRg5Q9rat1NgTWN6zrpYWnDUZ1JbsqH8Rui8TBYT4vyectprR8MFDfJg6LoNe0zM6_d4e2W1f5bKxN03T14AdoaZZ94Nj4xb7hBp8zhnpk4-n8SRXs May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: c6ad6af479db4e92933ac0d1567f25e1 May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-VolumesSnapshotTestJSON-284750157 May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:03:02.776916 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:03:02.778602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6ad6af479db4e92933ac0d1567f25e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c6ad6af479db4e92933ac0d1567f25e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c6ad6af479db4e92933ac0d1567f25e1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c6ad6af479db4e92933ac0d1567f25e1"}]}] May 26 17:03:02.778602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-VolumesSnapshotTestJSON-284750157 May 26 17:03:02.778602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: c6ad6af479db4e92933ac0d1567f25e1 May 26 17:03:02.778602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-284750157 May 26 17:03:02.778602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-VolumesSnapshotTestJSON-284750157-project May 26 17:03:02.778602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:03:02.778602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:03:02.778602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: 284df7837ac84a98992207ac01587020 May 26 17:03:02.778602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-VolumesSnapshotTestJSON-284750157-project May 26 17:03:02.778602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 17:03:02.778602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 could not be found. May 26 17:03:02.778602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': 'f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206'} May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 could not be found. May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:03:02.779610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 could not be found. May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 could not be found. May 26 17:03:02.781123 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:03:02.783329 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-fbaaec14-367a-4276-be08-093593ebc100 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] Returning 404 to user: Instance f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:03:02.784378 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-fbaaec14-367a-4276-be08-093593ebc100 tempest-VolumesSnapshotTestJSON-284750157 tempest-VolumesSnapshotTestJSON-284750157-project] 10.222.0.48 "GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206" status: 404 len: 111 microversion: 2.1 time: 0.043421 May 26 17:03:02.789168 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 573/1156] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:02 2022] GET /compute/v2.1/servers/f7ceba8a-bd4d-4d1d-a77e-c31c46ce0206 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:03:02.855000 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5206f092-b1ff-4cd3-8aa1-330b48096a7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:02.856919 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5206f092-b1ff-4cd3-8aa1-330b48096a7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:02.872870 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5206f092-b1ff-4cd3-8aa1-330b48096a7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:02.876425 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5206f092-b1ff-4cd3-8aa1-330b48096a7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:02.876425 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5206f092-b1ff-4cd3-8aa1-330b48096a7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:02.876425 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5206f092-b1ff-4cd3-8aa1-330b48096a7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:02.941544 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-57d9c937-212a-4af9-a4f0-3a6dd26ec34c req-dba7d33d-d6ac-4d66-9906-7bfbb646282d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7892d0ad-12f2-4fd6-ab09-771e48e98dd2", "tag": "6a11e212-e4cf-4d6b-95e6-04b99b515738"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:02.964754 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-57d9c937-212a-4af9-a4f0-3a6dd26ec34c req-dba7d33d-d6ac-4d66-9906-7bfbb646282d service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:02.965155 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-57d9c937-212a-4af9-a4f0-3a6dd26ec34c req-dba7d33d-d6ac-4d66-9906-7bfbb646282d service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:02.997885 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-57d9c937-212a-4af9-a4f0-3a6dd26ec34c req-dba7d33d-d6ac-4d66-9906-7bfbb646282d service nova] Creating event network-changed:6a11e212-e4cf-4d6b-95e6-04b99b515738 for instance 7892d0ad-12f2-4fd6-ab09-771e48e98dd2 on hv-cinder-83607 May 26 17:03:03.000881 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-57d9c937-212a-4af9-a4f0-3a6dd26ec34c req-dba7d33d-d6ac-4d66-9906-7bfbb646282d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063573 May 26 17:03:03.005959 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 574/1157] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:03:03.012595 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-d20d28de-31ed-4151-8c26-245fe3bc1144 req-8cbc6a7c-77a4-41cc-958f-a66f3b80b5be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "069ea022-ac65-467b-b615-e29bad8d2e3c", "tag": "7fa00f3b-5d93-4d84-b4ea-1c32eaac57c7"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:03.022543 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-d20d28de-31ed-4151-8c26-245fe3bc1144 req-8cbc6a7c-77a4-41cc-958f-a66f3b80b5be service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:03.023381 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-d20d28de-31ed-4151-8c26-245fe3bc1144 req-8cbc6a7c-77a4-41cc-958f-a66f3b80b5be service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:03.035241 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-d20d28de-31ed-4151-8c26-245fe3bc1144 req-8cbc6a7c-77a4-41cc-958f-a66f3b80b5be service nova] Creating event network-changed:7fa00f3b-5d93-4d84-b4ea-1c32eaac57c7 for instance 069ea022-ac65-467b-b615-e29bad8d2e3c on hv-cinder-83607 May 26 17:03:03.042812 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-d20d28de-31ed-4151-8c26-245fe3bc1144 req-8cbc6a7c-77a4-41cc-958f-a66f3b80b5be service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032938 May 26 17:03:03.042812 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 575/1158] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:03:03.058360 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5206f092-b1ff-4cd3-8aa1-330b48096a7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:03.076602 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5206f092-b1ff-4cd3-8aa1-330b48096a7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1315 microversion: 2.1 time: 0.216185 May 26 17:03:03.085316 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 584/1159] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:02 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:04.094982 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7296f785-5552-47c3-8dd1-ff3a6474e03c tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:04.095710 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7296f785-5552-47c3-8dd1-ff3a6474e03c tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:04.102912 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7296f785-5552-47c3-8dd1-ff3a6474e03c tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:04.103382 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7296f785-5552-47c3-8dd1-ff3a6474e03c tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:04.104148 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7296f785-5552-47c3-8dd1-ff3a6474e03c tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:04.104663 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7296f785-5552-47c3-8dd1-ff3a6474e03c tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:04.249599 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7296f785-5552-47c3-8dd1-ff3a6474e03c tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:04.259218 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7296f785-5552-47c3-8dd1-ff3a6474e03c tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1315 microversion: 2.1 time: 0.169010 May 26 17:03:04.259819 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 576/1160] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:04 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:05.276238 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5d1780a6-3b43-4920-a257-7c215c4a314b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:05.280372 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5d1780a6-3b43-4920-a257-7c215c4a314b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:05.280372 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:05.280372 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=8 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:05.285422 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d1780a6-3b43-4920-a257-7c215c4a314b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:05.285883 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d1780a6-3b43-4920-a257-7c215c4a314b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:05.286671 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d1780a6-3b43-4920-a257-7c215c4a314b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:05.287269 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5d1780a6-3b43-4920-a257-7c215c4a314b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:05.422030 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5d1780a6-3b43-4920-a257-7c215c4a314b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:05.429990 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5d1780a6-3b43-4920-a257-7c215c4a314b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1315 microversion: 2.1 time: 0.157680 May 26 17:03:05.430553 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 585/1161] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:05 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:06.447594 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3c2ebe45-c8bf-436c-ad01-89b0671a135a tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:06.448161 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3c2ebe45-c8bf-436c-ad01-89b0671a135a tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:06.450140 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:06.455529 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3c2ebe45-c8bf-436c-ad01-89b0671a135a tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:06.455985 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3c2ebe45-c8bf-436c-ad01-89b0671a135a tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:06.456747 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3c2ebe45-c8bf-436c-ad01-89b0671a135a tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:06.457192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3c2ebe45-c8bf-436c-ad01-89b0671a135a tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:06.585771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3c2ebe45-c8bf-436c-ad01-89b0671a135a tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:06.593181 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3c2ebe45-c8bf-436c-ad01-89b0671a135a tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1315 microversion: 2.1 time: 0.149691 May 26 17:03:06.593785 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 577/1162] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:06 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:07.610925 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-dcd54b6f-19b9-4b5f-83a2-010f41ca51e6 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:07.611830 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-dcd54b6f-19b9-4b5f-83a2-010f41ca51e6 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:07.619034 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dcd54b6f-19b9-4b5f-83a2-010f41ca51e6 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:07.619506 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dcd54b6f-19b9-4b5f-83a2-010f41ca51e6 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:07.620257 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dcd54b6f-19b9-4b5f-83a2-010f41ca51e6 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:07.620702 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-dcd54b6f-19b9-4b5f-83a2-010f41ca51e6 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:07.754196 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-dcd54b6f-19b9-4b5f-83a2-010f41ca51e6 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:07.761644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-dcd54b6f-19b9-4b5f-83a2-010f41ca51e6 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1315 microversion: 2.1 time: 0.154645 May 26 17:03:07.762212 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 586/1163] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:07 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:08.779715 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-dde236dd-b152-4ca3-b464-319b45b5ef4e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:08.780362 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-dde236dd-b152-4ca3-b464-319b45b5ef4e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:08.786990 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dde236dd-b152-4ca3-b464-319b45b5ef4e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:08.787439 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dde236dd-b152-4ca3-b464-319b45b5ef4e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:08.788188 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dde236dd-b152-4ca3-b464-319b45b5ef4e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:08.788617 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dde236dd-b152-4ca3-b464-319b45b5ef4e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:08.918826 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-dde236dd-b152-4ca3-b464-319b45b5ef4e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:08.927305 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-dde236dd-b152-4ca3-b464-319b45b5ef4e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1315 microversion: 2.1 time: 0.151759 May 26 17:03:08.927931 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 578/1164] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:08 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:09.944148 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9ce546b4-40d0-4650-92d8-24e00ca2e46b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:09.944775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9ce546b4-40d0-4650-92d8-24e00ca2e46b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:09.951706 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9ce546b4-40d0-4650-92d8-24e00ca2e46b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:09.952164 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9ce546b4-40d0-4650-92d8-24e00ca2e46b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:09.952937 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9ce546b4-40d0-4650-92d8-24e00ca2e46b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:09.953414 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9ce546b4-40d0-4650-92d8-24e00ca2e46b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:10.056839 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-5e581062-e1e9-48f6-b160-d7f5fed0a9f8 req-0784b09c-d8fb-4bb8-bb2e-f2647063016b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "069ea022-ac65-467b-b615-e29bad8d2e3c", "name": "network-vif-plugged", "status": "completed", "tag": "7fa00f3b-5d93-4d84-b4ea-1c32eaac57c7"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:10.068334 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-5e581062-e1e9-48f6-b160-d7f5fed0a9f8 req-0784b09c-d8fb-4bb8-bb2e-f2647063016b service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:10.069054 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-5e581062-e1e9-48f6-b160-d7f5fed0a9f8 req-0784b09c-d8fb-4bb8-bb2e-f2647063016b service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:10.116860 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-5e581062-e1e9-48f6-b160-d7f5fed0a9f8 req-0784b09c-d8fb-4bb8-bb2e-f2647063016b service nova] Creating event network-vif-plugged:7fa00f3b-5d93-4d84-b4ea-1c32eaac57c7 for instance 069ea022-ac65-467b-b615-e29bad8d2e3c on hv-cinder-83607 May 26 17:03:10.134878 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-5e581062-e1e9-48f6-b160-d7f5fed0a9f8 req-0784b09c-d8fb-4bb8-bb2e-f2647063016b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070730 May 26 17:03:10.134878 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 579/1165] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:03:10.135138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9ce546b4-40d0-4650-92d8-24e00ca2e46b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:10.137583 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9ce546b4-40d0-4650-92d8-24e00ca2e46b tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1315 microversion: 2.1 time: 0.197230 May 26 17:03:10.138161 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 587/1166] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:09 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:11.155322 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-5998ac40-ae43-4dc0-867e-ec84abb9c550 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:11.156080 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-5998ac40-ae43-4dc0-867e-ec84abb9c550 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:11.162882 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5998ac40-ae43-4dc0-867e-ec84abb9c550 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:11.163332 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5998ac40-ae43-4dc0-867e-ec84abb9c550 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:11.164084 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5998ac40-ae43-4dc0-867e-ec84abb9c550 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:11.164518 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-5998ac40-ae43-4dc0-867e-ec84abb9c550 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:11.301387 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-5998ac40-ae43-4dc0-867e-ec84abb9c550 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:11.309277 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-5998ac40-ae43-4dc0-867e-ec84abb9c550 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1315 microversion: 2.1 time: 0.158743 May 26 17:03:11.312032 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 580/1167] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:11 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:12.327115 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9fd49f05-0450-4b17-a234-5defb30b8c11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:12.327688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9fd49f05-0450-4b17-a234-5defb30b8c11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:12.334820 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9fd49f05-0450-4b17-a234-5defb30b8c11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:12.336620 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9fd49f05-0450-4b17-a234-5defb30b8c11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:12.336620 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9fd49f05-0450-4b17-a234-5defb30b8c11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:12.336620 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9fd49f05-0450-4b17-a234-5defb30b8c11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:12.470730 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9fd49f05-0450-4b17-a234-5defb30b8c11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:12.479383 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9fd49f05-0450-4b17-a234-5defb30b8c11 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1465 microversion: 2.1 time: 0.156256 May 26 17:03:12.479953 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 588/1168] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:12 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1465 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:12.521668 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9ef987b6-e0e7-4167-a638-5691d68a8d19 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:12.522236 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9ef987b6-e0e7-4167-a638-5691d68a8d19 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:12.528650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ef987b6-e0e7-4167-a638-5691d68a8d19 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:12.529103 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ef987b6-e0e7-4167-a638-5691d68a8d19 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:12.530062 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ef987b6-e0e7-4167-a638-5691d68a8d19 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:12.530515 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ef987b6-e0e7-4167-a638-5691d68a8d19 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:12.555673 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9ef987b6-e0e7-4167-a638-5691d68a8d19 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:03:12.857695 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9ef987b6-e0e7-4167-a638-5691d68a8d19 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "DELETE /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 204 len: 0 microversion: 2.1 time: 0.340275 May 26 17:03:12.859110 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 581/1169] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:03:12 2022] DELETE /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:03:12.868018 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-93cca843-f50e-459c-85b9-2051e7330b7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:12.868763 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-93cca843-f50e-459c-85b9-2051e7330b7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:12.874823 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-93cca843-f50e-459c-85b9-2051e7330b7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:12.875200 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-93cca843-f50e-459c-85b9-2051e7330b7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:12.875960 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-93cca843-f50e-459c-85b9-2051e7330b7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:12.876400 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-93cca843-f50e-459c-85b9-2051e7330b7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:13.006043 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-93cca843-f50e-459c-85b9-2051e7330b7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:13.014138 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-93cca843-f50e-459c-85b9-2051e7330b7e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1471 microversion: 2.1 time: 0.150001 May 26 17:03:13.014702 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 589/1170] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:12 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:14.031477 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-27e0a214-1d7e-44d0-a718-8b2acc3bb4e2 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:14.032206 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-27e0a214-1d7e-44d0-a718-8b2acc3bb4e2 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:14.039460 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-27e0a214-1d7e-44d0-a718-8b2acc3bb4e2 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:14.039909 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-27e0a214-1d7e-44d0-a718-8b2acc3bb4e2 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:14.040660 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-27e0a214-1d7e-44d0-a718-8b2acc3bb4e2 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:14.041100 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-27e0a214-1d7e-44d0-a718-8b2acc3bb4e2 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:14.182417 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-27e0a214-1d7e-44d0-a718-8b2acc3bb4e2 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:14.191435 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-27e0a214-1d7e-44d0-a718-8b2acc3bb4e2 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1471 microversion: 2.1 time: 0.164310 May 26 17:03:14.192015 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 582/1171] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:14 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:15.208554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4ecf47b5-44b7-4c8b-be75-6a3d9768d43e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:15.209808 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4ecf47b5-44b7-4c8b-be75-6a3d9768d43e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:15.220537 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4ecf47b5-44b7-4c8b-be75-6a3d9768d43e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:15.220537 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4ecf47b5-44b7-4c8b-be75-6a3d9768d43e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:15.220537 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4ecf47b5-44b7-4c8b-be75-6a3d9768d43e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:15.220537 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4ecf47b5-44b7-4c8b-be75-6a3d9768d43e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:15.222414 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-7ce0ecf9-1463-43a1-b8be-f5775705472e req-15288e4c-6081-47fb-bb16-64488660c1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "069ea022-ac65-467b-b615-e29bad8d2e3c", "name": "network-vif-deleted", "tag": "7fa00f3b-5d93-4d84-b4ea-1c32eaac57c7"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:15.235728 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-7ce0ecf9-1463-43a1-b8be-f5775705472e req-15288e4c-6081-47fb-bb16-64488660c1fd service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:15.240006 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-7ce0ecf9-1463-43a1-b8be-f5775705472e req-15288e4c-6081-47fb-bb16-64488660c1fd service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:15.251268 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-7ce0ecf9-1463-43a1-b8be-f5775705472e req-15288e4c-6081-47fb-bb16-64488660c1fd service nova] Creating event network-vif-deleted:7fa00f3b-5d93-4d84-b4ea-1c32eaac57c7 for instance 069ea022-ac65-467b-b615-e29bad8d2e3c on hv-cinder-83607 May 26 17:03:15.258630 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-7ce0ecf9-1463-43a1-b8be-f5775705472e req-15288e4c-6081-47fb-bb16-64488660c1fd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040886 May 26 17:03:15.259934 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 583/1172] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:03:15.293563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4ecf47b5-44b7-4c8b-be75-6a3d9768d43e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:15.302475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4ecf47b5-44b7-4c8b-be75-6a3d9768d43e tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1429 microversion: 2.1 time: 0.098254 May 26 17:03:15.303157 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 590/1173] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:15 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1429 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:16.321174 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f1a8a401-5798-4dc4-a317-d2a435453abf tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:16.322037 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f1a8a401-5798-4dc4-a317-d2a435453abf tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:16.328186 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f1a8a401-5798-4dc4-a317-d2a435453abf tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:16.328646 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f1a8a401-5798-4dc4-a317-d2a435453abf tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:16.329470 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f1a8a401-5798-4dc4-a317-d2a435453abf tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:16.329920 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f1a8a401-5798-4dc4-a317-d2a435453abf tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:16.395302 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f1a8a401-5798-4dc4-a317-d2a435453abf tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:16.402947 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f1a8a401-5798-4dc4-a317-d2a435453abf tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1429 microversion: 2.1 time: 0.087362 May 26 17:03:16.403512 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 584/1174] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:16 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1429 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:17.421249 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-69d9195b-ae8e-4e45-800b-97343f891a32 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:17.421877 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-69d9195b-ae8e-4e45-800b-97343f891a32 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:17.428239 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69d9195b-ae8e-4e45-800b-97343f891a32 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:17.432583 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69d9195b-ae8e-4e45-800b-97343f891a32 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:17.432583 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69d9195b-ae8e-4e45-800b-97343f891a32 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:17.432583 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-69d9195b-ae8e-4e45-800b-97343f891a32 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:17.650206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-69d9195b-ae8e-4e45-800b-97343f891a32 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:17.657855 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-69d9195b-ae8e-4e45-800b-97343f891a32 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1429 microversion: 2.1 time: 0.240833 May 26 17:03:17.658523 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 591/1175] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:17 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1429 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:18.676249 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f7c32c14-fbfd-4ef3-b04b-acc3e057bcbb tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:18.676797 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f7c32c14-fbfd-4ef3-b04b-acc3e057bcbb tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:18.683687 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7c32c14-fbfd-4ef3-b04b-acc3e057bcbb tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:18.684164 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7c32c14-fbfd-4ef3-b04b-acc3e057bcbb tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:18.686680 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7c32c14-fbfd-4ef3-b04b-acc3e057bcbb tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:18.686680 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7c32c14-fbfd-4ef3-b04b-acc3e057bcbb tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:18.716841 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7c32c14-fbfd-4ef3-b04b-acc3e057bcbb tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:18.717315 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f7c32c14-fbfd-4ef3-b04b-acc3e057bcbb tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:18.717770 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-f7c32c14-fbfd-4ef3-b04b-acc3e057bcbb tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lazy-loading 'fault' on Instance uuid 069ea022-ac65-467b-b615-e29bad8d2e3c {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:03:18.760867 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-f7c32c14-fbfd-4ef3-b04b-acc3e057bcbb tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd4ebe90383349929464a3dca691b92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5709ce2fac32449a929d5a4064fdd532', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:18.769802 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f7c32c14-fbfd-4ef3-b04b-acc3e057bcbb tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 200 len: 1305 microversion: 2.1 time: 0.098271 May 26 17:03:18.779568 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 585/1176] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:18 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:03:19.787159 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-247a60fb-39a0-4062-a2f6-a794e7771381 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:19.787685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-247a60fb-39a0-4062-a2f6-a794e7771381 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] [instance: 069ea022-ac65-467b-b615-e29bad8d2e3c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:19.794225 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-247a60fb-39a0-4062-a2f6-a794e7771381 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:19.794682 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-247a60fb-39a0-4062-a2f6-a794e7771381 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:19.795455 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-247a60fb-39a0-4062-a2f6-a794e7771381 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:19.795918 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-247a60fb-39a0-4062-a2f6-a794e7771381 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:19.809424 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-247a60fb-39a0-4062-a2f6-a794e7771381 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] HTTP exception thrown: Instance 069ea022-ac65-467b-b615-e29bad8d2e3c could not be found. May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-247a60fb-39a0-4062-a2f6-a794e7771381 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Request method failure captured: May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c HTTP/1.1 May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7K6dzRASAX5Abk5Rigfr2YN-NUzd6ADxBESDNZbvQLsGwEJuQ9LzEwP_uxij_TYungwFroHKY2Co0JNcNiQQi4dQQLSiz4W0PG5Y-psFEoIfqzcnpceXrv7rqH9z7fKjQ34TljIsTCA_x5ekNCPBwwbe_43Uwv-viosN3WTDhqE0fM May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 5709ce2fac32449a929d5a4064fdd532 May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-VolumesNegativeTest-639171507 May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:03:19.811073 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:03:19.812744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5709ce2fac32449a929d5a4064fdd532"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5709ce2fac32449a929d5a4064fdd532"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5709ce2fac32449a929d5a4064fdd532", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5709ce2fac32449a929d5a4064fdd532"}]}] May 26 17:03:19.812744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-VolumesNegativeTest-639171507 May 26 17:03:19.812744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 5709ce2fac32449a929d5a4064fdd532 May 26 17:03:19.812744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-VolumesNegativeTest-639171507 May 26 17:03:19.812744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-VolumesNegativeTest-639171507-project May 26 17:03:19.812744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:03:19.812744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:03:19.812744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: fd4ebe90383349929464a3dca691b92b May 26 17:03:19.812744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-VolumesNegativeTest-639171507-project May 26 17:03:19.812744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:03:19.812744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 069ea022-ac65-467b-b615-e29bad8d2e3c could not be found. May 26 17:03:19.812744 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '069ea022-ac65-467b-b615-e29bad8d2e3c'} May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 069ea022-ac65-467b-b615-e29bad8d2e3c could not be found. May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:03:19.813867 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 069ea022-ac65-467b-b615-e29bad8d2e3c could not be found. May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 069ea022-ac65-467b-b615-e29bad8d2e3c could not be found. May 26 17:03:19.815475 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:03:19.816854 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-247a60fb-39a0-4062-a2f6-a794e7771381 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] Returning 404 to user: Instance 069ea022-ac65-467b-b615-e29bad8d2e3c could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:03:19.816854 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-247a60fb-39a0-4062-a2f6-a794e7771381 tempest-VolumesNegativeTest-639171507 tempest-VolumesNegativeTest-639171507-project] 10.222.0.48 "GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c" status: 404 len: 111 microversion: 2.1 time: 0.030241 May 26 17:03:19.816854 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 592/1177] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:19 2022] GET /compute/v2.1/servers/069ea022-ac65-467b-b615-e29bad8d2e3c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:03:33.304821 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:03:33.305546 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Thu May 26 17:03:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:03:40.148103 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3522693c-73b8-4362-b633-1a93aef85605 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:40.148935 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3522693c-73b8-4362-b633-1a93aef85605 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:40.152608 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:40.157747 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-0d1bbdbb-d5bd-4450-9c39-80f7365586a1 req-75bc9d0d-92ed-4b6f-92bb-5770de4dd179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b981b012-8995-4185-9b5c-03934263a18c", "tag": "dd6991b4-2331-41f4-a211-234d1b499987"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:40.158526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:40.161887 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3522693c-73b8-4362-b633-1a93aef85605 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:40.162657 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3522693c-73b8-4362-b633-1a93aef85605 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:40.163701 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3522693c-73b8-4362-b633-1a93aef85605 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:40.164260 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3522693c-73b8-4362-b633-1a93aef85605 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:40.165380 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=21 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:40.169007 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=71 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:40.177014 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-0d1bbdbb-d5bd-4450-9c39-80f7365586a1 req-75bc9d0d-92ed-4b6f-92bb-5770de4dd179 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:40.180727 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-0d1bbdbb-d5bd-4450-9c39-80f7365586a1 req-75bc9d0d-92ed-4b6f-92bb-5770de4dd179 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:40.194461 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-0d1bbdbb-d5bd-4450-9c39-80f7365586a1 req-75bc9d0d-92ed-4b6f-92bb-5770de4dd179 service nova] Creating event network-changed:dd6991b4-2331-41f4-a211-234d1b499987 for instance b981b012-8995-4185-9b5c-03934263a18c on hv-cinder-83607 May 26 17:03:40.202884 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-0d1bbdbb-d5bd-4450-9c39-80f7365586a1 req-75bc9d0d-92ed-4b6f-92bb-5770de4dd179 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055908 May 26 17:03:40.204128 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 593/1178] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:03:40.205975 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3522693c-73b8-4362-b633-1a93aef85605 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:03:40.592963 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3522693c-73b8-4362-b633-1a93aef85605 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 204 len: 0 microversion: 2.1 time: 0.451502 May 26 17:03:40.595192 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 586/1179] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:03:40 2022] DELETE /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:03:40.605803 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a83a94b1-8355-4d1e-9a65-f5d710ed456c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:40.606604 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a83a94b1-8355-4d1e-9a65-f5d710ed456c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:40.614283 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a83a94b1-8355-4d1e-9a65-f5d710ed456c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:40.614953 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a83a94b1-8355-4d1e-9a65-f5d710ed456c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:40.615903 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a83a94b1-8355-4d1e-9a65-f5d710ed456c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:40.616432 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a83a94b1-8355-4d1e-9a65-f5d710ed456c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:40.790256 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a83a94b1-8355-4d1e-9a65-f5d710ed456c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:40.808077 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a83a94b1-8355-4d1e-9a65-f5d710ed456c tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.207042 May 26 17:03:40.808678 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 594/1180] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:40 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:41.834618 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-72010896-e134-4e50-9d0a-780ee73af77a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:41.836951 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-72010896-e134-4e50-9d0a-780ee73af77a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:41.850338 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72010896-e134-4e50-9d0a-780ee73af77a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:41.851072 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72010896-e134-4e50-9d0a-780ee73af77a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:41.852278 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72010896-e134-4e50-9d0a-780ee73af77a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:41.852934 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-72010896-e134-4e50-9d0a-780ee73af77a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:42.438635 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-72010896-e134-4e50-9d0a-780ee73af77a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:42.450442 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-72010896-e134-4e50-9d0a-780ee73af77a tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1569 microversion: 2.1 time: 0.625952 May 26 17:03:42.452323 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 587/1181] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:41 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1569 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:43.247315 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-5c866f2d-9980-4298-8376-876085d60118 req-6b5b2f9f-9788-46d1-8596-09f992098b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b981b012-8995-4185-9b5c-03934263a18c", "name": "network-vif-deleted", "tag": "dd6991b4-2331-41f4-a211-234d1b499987"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:43.264005 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-5c866f2d-9980-4298-8376-876085d60118 req-6b5b2f9f-9788-46d1-8596-09f992098b68 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:43.264539 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-5c866f2d-9980-4298-8376-876085d60118 req-6b5b2f9f-9788-46d1-8596-09f992098b68 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:43.279461 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-5c866f2d-9980-4298-8376-876085d60118 req-6b5b2f9f-9788-46d1-8596-09f992098b68 service nova] Creating event network-vif-deleted:dd6991b4-2331-41f4-a211-234d1b499987 for instance b981b012-8995-4185-9b5c-03934263a18c on hv-cinder-83607 May 26 17:03:43.285148 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-5c866f2d-9980-4298-8376-876085d60118 req-6b5b2f9f-9788-46d1-8596-09f992098b68 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041682 May 26 17:03:43.290930 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 595/1182] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:03:43.476569 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b9b367dd-189c-4b08-b5d8-5aa9499eccfa tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:43.477760 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b9b367dd-189c-4b08-b5d8-5aa9499eccfa tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:43.511768 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b9b367dd-189c-4b08-b5d8-5aa9499eccfa tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:43.517430 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b9b367dd-189c-4b08-b5d8-5aa9499eccfa tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:43.519359 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b9b367dd-189c-4b08-b5d8-5aa9499eccfa tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:43.522071 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b9b367dd-189c-4b08-b5d8-5aa9499eccfa tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:43.666442 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b9b367dd-189c-4b08-b5d8-5aa9499eccfa tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:43.670857 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b9b367dd-189c-4b08-b5d8-5aa9499eccfa tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1220 microversion: 2.1 time: 0.205775 May 26 17:03:43.671644 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 588/1183] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:43 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1220 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:44.689477 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b177f831-9063-4811-a3f5-fa0d6ae224c1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:44.690118 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b177f831-9063-4811-a3f5-fa0d6ae224c1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:44.705528 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b177f831-9063-4811-a3f5-fa0d6ae224c1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:44.705933 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b177f831-9063-4811-a3f5-fa0d6ae224c1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:44.706847 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b177f831-9063-4811-a3f5-fa0d6ae224c1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:44.707294 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b177f831-9063-4811-a3f5-fa0d6ae224c1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:44.771134 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b177f831-9063-4811-a3f5-fa0d6ae224c1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:44.771800 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b177f831-9063-4811-a3f5-fa0d6ae224c1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:44.773035 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-b177f831-9063-4811-a3f5-fa0d6ae224c1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lazy-loading 'fault' on Instance uuid b981b012-8995-4185-9b5c-03934263a18c {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:03:44.843529 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b177f831-9063-4811-a3f5-fa0d6ae224c1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e68c10e83634018b70ca664e1e8f08c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9562e9c747f4808a67c01436d9ede47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:03:44.855821 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b177f831-9063-4811-a3f5-fa0d6ae224c1 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 200 len: 1225 microversion: 2.1 time: 0.171004 May 26 17:03:44.857153 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 596/1184] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:44 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 1225 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:03:45.878610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ca9873fd-8062-4bb4-9115-6bdb40646228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:45.880198 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-ca9873fd-8062-4bb4-9115-6bdb40646228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] [instance: b981b012-8995-4185-9b5c-03934263a18c] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:03:45.887550 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca9873fd-8062-4bb4-9115-6bdb40646228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:45.888111 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca9873fd-8062-4bb4-9115-6bdb40646228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:45.889017 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca9873fd-8062-4bb4-9115-6bdb40646228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:03:45.889773 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-ca9873fd-8062-4bb4-9115-6bdb40646228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:03:45.904795 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-ca9873fd-8062-4bb4-9115-6bdb40646228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] HTTP exception thrown: Instance b981b012-8995-4185-9b5c-03934263a18c could not be found. May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ca9873fd-8062-4bb4-9115-6bdb40646228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Request method failure captured: May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c HTTP/1.1 May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7GosNdLms_10ojwLY1NcXscRubsQihFi_zICn7McAK5YwDewR7v0myJDKv5QB5mazgoKYV3vrBXDJ2TfpA5m2x_8eHswBztF0Z-z-ECm4ojIf1IU_bSrGNk_x0Mk67N1GyUbLgY9HKIT5XLnr1-DLY-pkluoTl42pDwUOahwxbrMaQ May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: b9562e9c747f4808a67c01436d9ede47 May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-TestShelveInstance-617444017 May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:03:45.906602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:03:45.908928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9562e9c747f4808a67c01436d9ede47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b9562e9c747f4808a67c01436d9ede47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b9562e9c747f4808a67c01436d9ede47", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b9562e9c747f4808a67c01436d9ede47"}]}] May 26 17:03:45.908928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-TestShelveInstance-617444017 May 26 17:03:45.908928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: b9562e9c747f4808a67c01436d9ede47 May 26 17:03:45.908928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-TestShelveInstance-617444017 May 26 17:03:45.908928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-TestShelveInstance-617444017-project May 26 17:03:45.908928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:03:45.908928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:03:45.908928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: 4e68c10e83634018b70ca664e1e8f08c May 26 17:03:45.908928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-TestShelveInstance-617444017-project May 26 17:03:45.908928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 17:03:45.908928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance b981b012-8995-4185-9b5c-03934263a18c could not be found. May 26 17:03:45.908928 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': 'b981b012-8995-4185-9b5c-03934263a18c'} May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b981b012-8995-4185-9b5c-03934263a18c could not be found. May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:03:45.909966 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b981b012-8995-4185-9b5c-03934263a18c could not be found. May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b981b012-8995-4185-9b5c-03934263a18c could not be found. May 26 17:03:45.912622 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:03:45.914504 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-ca9873fd-8062-4bb4-9115-6bdb40646228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Returning 404 to user: Instance b981b012-8995-4185-9b5c-03934263a18c could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:03:45.914504 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-ca9873fd-8062-4bb4-9115-6bdb40646228 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c" status: 404 len: 111 microversion: 2.1 time: 0.034437 May 26 17:03:45.914504 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 589/1185] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:03:45 2022] GET /compute/v2.1/servers/b981b012-8995-4185-9b5c-03934263a18c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:03:46.350563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ea201021-2e5c-4768-9488-aefc7479ab88 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] Calling method '.version_select at 0x7fbe80436d30>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:03:46.458195 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ea201021-2e5c-4768-9488-aefc7479ab88 tempest-TestShelveInstance-617444017 tempest-TestShelveInstance-617444017-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1495379482" status: 202 len: 0 microversion: 2.1 time: 0.113169 May 26 17:03:46.462190 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 597/1186] 10.222.0.48 () {58 vars in 1253 bytes} [Thu May 26 17:03:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1495379482 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:03:59.801647 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-1d97fb6a-2cfd-484f-8c16-cda8abf97499 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Action: 'create', calling method: .version_select at 0x7fbe804a0820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1292168754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGPh6DOHC3CkFCd/UB/7BLm4H6I+chjzxgqNqMDlyILSFWxU967Hf4cM8XxvLz4dlnWNqOSz8ybb2vaxW9I0gaSZpw7wOQ9VzJIc5TX/PVf8/eGvoEv6aJsWFcZScWYJA=="}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:03:59.807525 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:59.808638 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:59.823281 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-1d97fb6a-2cfd-484f-8c16-cda8abf97499 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Getting quotas for project 0087e93bc2524a29b22a4adedec49ea6. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:03:59.827890 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.quota [None req-1d97fb6a-2cfd-484f-8c16-cda8abf97499 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Getting quotas for user d4864aa668bd4b3ba45d9570d94d4601 and project 0087e93bc2524a29b22a4adedec49ea6. Resources: {'key_pairs'} {{(pid=124837) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:03:59.931708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-1d97fb6a-2cfd-484f-8c16-cda8abf97499 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.135283 May 26 17:03:59.932231 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 590/1187] 10.222.0.48 () {60 vars in 1158 bytes} [Thu May 26 17:03:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:04:00.031280 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=18 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:00.032107 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:00.036664 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1595662297", "imageRef": "b447305e-986d-4300-9888-530feecc776e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1292168754", "networks": [{"uuid": "6dfe0d7a-74f2-4f9f-8fbf-213faa443ca2"}]}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:04:00.088449 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.network.neutron [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] validate_networks() for [('6dfe0d7a-74f2-4f9f-8fbf-213faa443ca2', None, None, None, None, None)] {{(pid=124836) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 17:04:00.572720 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Flavor limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 17:04:00.573158 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Image limits 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 17:04:00.573747 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Flavor pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 17:04:00.574168 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Image pref 0:0:0 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 17:04:00.574591 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.virt.hardware [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 17:04:00.584113 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:00.584568 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:00.585400 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:00.585844 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:00.603480 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Getting quotas for project 0087e93bc2524a29b22a4adedec49ea6. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 17:04:00.607457 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.quota [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Getting quotas for user d4864aa668bd4b3ba45d9570d94d4601 and project 0087e93bc2524a29b22a4adedec49ea6. Resources: {'instances', 'cores', 'ram'} {{(pid=124836) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 17:04:00.618427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Going to run 1 instances... {{(pid=124836) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 17:04:00.620630 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b447305e-986d-4300-9888-530feecc776e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124836) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 17:04:00.748967 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ccdad25a-0c03-4f2b-909a-6d6c08c9850e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719009 May 26 17:04:00.749645 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 598/1188] 10.222.0.48 () {60 vars in 1146 bytes} [Thu May 26 17:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 17:04:00.761136 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-6f7f0e1d-cd99-4f98-afdd-2045fd0e1f35 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:00.761781 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-6f7f0e1d-cd99-4f98-afdd-2045fd0e1f35 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:00.821099 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-6f7f0e1d-cd99-4f98-afdd-2045fd0e1f35 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:00.827788 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-6f7f0e1d-cd99-4f98-afdd-2045fd0e1f35 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1259 microversion: 2.1 time: 0.071409 May 26 17:04:00.828355 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 591/1189] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:00 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:01.846426 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-0b06865b-b2ed-4268-a085-a11bb62093ff tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:01.847114 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-0b06865b-b2ed-4268-a085-a11bb62093ff tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:01.902224 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-0b06865b-b2ed-4268-a085-a11bb62093ff tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:01.909064 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-0b06865b-b2ed-4268-a085-a11bb62093ff tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1259 microversion: 2.1 time: 0.067321 May 26 17:04:01.909603 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 599/1190] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:01 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:02.927322 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9a3dc890-9572-43ca-a317-479ca8e3f508 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:02.927958 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9a3dc890-9572-43ca-a317-479ca8e3f508 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:02.935485 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a3dc890-9572-43ca-a317-479ca8e3f508 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:02.935961 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a3dc890-9572-43ca-a317-479ca8e3f508 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:02.936740 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a3dc890-9572-43ca-a317-479ca8e3f508 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:02.937164 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a3dc890-9572-43ca-a317-479ca8e3f508 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:03.003653 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9a3dc890-9572-43ca-a317-479ca8e3f508 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:03.011949 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9a3dc890-9572-43ca-a317-479ca8e3f508 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1255 microversion: 2.1 time: 0.089581 May 26 17:04:03.012624 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 592/1191] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:02 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1255 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:04:04.029497 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8edf12a5-5d7c-4c6a-b898-5c0753b57dbc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:04.030249 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8edf12a5-5d7c-4c6a-b898-5c0753b57dbc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:04.038757 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8edf12a5-5d7c-4c6a-b898-5c0753b57dbc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:04.040685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8edf12a5-5d7c-4c6a-b898-5c0753b57dbc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:04.040685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8edf12a5-5d7c-4c6a-b898-5c0753b57dbc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:04.040685 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8edf12a5-5d7c-4c6a-b898-5c0753b57dbc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:04.108360 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-8edf12a5-5d7c-4c6a-b898-5c0753b57dbc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:04.117038 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8edf12a5-5d7c-4c6a-b898-5c0753b57dbc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1317 microversion: 2.1 time: 0.091637 May 26 17:04:04.124693 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 600/1192] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:04 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1317 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:05.138546 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-2faa9a2b-2dab-457f-a94e-5e3fd9847b1a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:05.140072 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-2faa9a2b-2dab-457f-a94e-5e3fd9847b1a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:05.153111 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2faa9a2b-2dab-457f-a94e-5e3fd9847b1a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:05.156917 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2faa9a2b-2dab-457f-a94e-5e3fd9847b1a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:05.161574 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2faa9a2b-2dab-457f-a94e-5e3fd9847b1a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:05.171310 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-2faa9a2b-2dab-457f-a94e-5e3fd9847b1a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:05.347249 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-2faa9a2b-2dab-457f-a94e-5e3fd9847b1a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:05.373525 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-2faa9a2b-2dab-457f-a94e-5e3fd9847b1a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1359 microversion: 2.1 time: 0.242630 May 26 17:04:05.374294 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 593/1193] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:05 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:05.929452 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-46819f5a-b85a-4b79-a59b-d9ae737e8772 req-4a66fec9-1fbe-4d6a-989e-f5f76f183844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6", "tag": "2cf5870a-e439-43e4-845e-634e2e36bb39"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:04:05.940983 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-46819f5a-b85a-4b79-a59b-d9ae737e8772 req-4a66fec9-1fbe-4d6a-989e-f5f76f183844 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:05.941524 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-46819f5a-b85a-4b79-a59b-d9ae737e8772 req-4a66fec9-1fbe-4d6a-989e-f5f76f183844 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:05.954793 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-46819f5a-b85a-4b79-a59b-d9ae737e8772 req-4a66fec9-1fbe-4d6a-989e-f5f76f183844 service nova] Creating event network-changed:2cf5870a-e439-43e4-845e-634e2e36bb39 for instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 on hv-cinder-83607 May 26 17:04:05.960264 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-46819f5a-b85a-4b79-a59b-d9ae737e8772 req-4a66fec9-1fbe-4d6a-989e-f5f76f183844 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297518 May 26 17:04:05.961208 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 601/1194] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:04:06.391431 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4da5923d-6cc3-448f-9e35-57b7833b1abb tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:06.391980 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4da5923d-6cc3-448f-9e35-57b7833b1abb tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:06.398917 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4da5923d-6cc3-448f-9e35-57b7833b1abb tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:06.399361 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4da5923d-6cc3-448f-9e35-57b7833b1abb tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:06.400134 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4da5923d-6cc3-448f-9e35-57b7833b1abb tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:06.400574 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4da5923d-6cc3-448f-9e35-57b7833b1abb tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:06.553314 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4da5923d-6cc3-448f-9e35-57b7833b1abb tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:06.556262 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4da5923d-6cc3-448f-9e35-57b7833b1abb tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1359 microversion: 2.1 time: 0.168881 May 26 17:04:06.556833 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 594/1195] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:06 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:07.574066 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-7824f159-9bf8-4e2b-b101-cc8390145832 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:07.574909 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-7824f159-9bf8-4e2b-b101-cc8390145832 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:07.582979 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7824f159-9bf8-4e2b-b101-cc8390145832 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:07.583431 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7824f159-9bf8-4e2b-b101-cc8390145832 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:07.584207 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7824f159-9bf8-4e2b-b101-cc8390145832 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:07.584774 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-7824f159-9bf8-4e2b-b101-cc8390145832 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:07.734972 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-7824f159-9bf8-4e2b-b101-cc8390145832 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:07.744539 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-7824f159-9bf8-4e2b-b101-cc8390145832 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1359 microversion: 2.1 time: 0.174688 May 26 17:04:07.754893 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 602/1196] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:07 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:08.763455 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bbac1e8b-3386-4c78-9c54-cf0b39519e0a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:08.764203 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bbac1e8b-3386-4c78-9c54-cf0b39519e0a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:08.771814 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bbac1e8b-3386-4c78-9c54-cf0b39519e0a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:08.772233 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bbac1e8b-3386-4c78-9c54-cf0b39519e0a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:08.773017 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bbac1e8b-3386-4c78-9c54-cf0b39519e0a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:08.773537 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bbac1e8b-3386-4c78-9c54-cf0b39519e0a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:08.919193 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-bbac1e8b-3386-4c78-9c54-cf0b39519e0a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:08.927718 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bbac1e8b-3386-4c78-9c54-cf0b39519e0a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1359 microversion: 2.1 time: 0.168732 May 26 17:04:08.928298 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 595/1197] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:08 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:09.945855 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-09ee1eab-2e11-437b-a256-b4c9c4eaaf1b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:09.946427 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-09ee1eab-2e11-437b-a256-b4c9c4eaaf1b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:09.954056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-09ee1eab-2e11-437b-a256-b4c9c4eaaf1b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:09.954462 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-09ee1eab-2e11-437b-a256-b4c9c4eaaf1b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:09.955242 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-09ee1eab-2e11-437b-a256-b4c9c4eaaf1b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:09.955705 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-09ee1eab-2e11-437b-a256-b4c9c4eaaf1b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:10.104159 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-09ee1eab-2e11-437b-a256-b4c9c4eaaf1b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:10.112695 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-09ee1eab-2e11-437b-a256-b4c9c4eaaf1b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1359 microversion: 2.1 time: 0.171626 May 26 17:04:10.113837 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 603/1198] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:09 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:11.130576 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0c5e2e1c-b5ec-4f57-b218-13bba96c77a4 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:11.131185 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0c5e2e1c-b5ec-4f57-b218-13bba96c77a4 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:11.133970 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell0:SELECT=6 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:11.138965 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0c5e2e1c-b5ec-4f57-b218-13bba96c77a4 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:11.139475 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0c5e2e1c-b5ec-4f57-b218-13bba96c77a4 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:11.140219 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0c5e2e1c-b5ec-4f57-b218-13bba96c77a4 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:11.140668 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0c5e2e1c-b5ec-4f57-b218-13bba96c77a4 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:11.286377 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0c5e2e1c-b5ec-4f57-b218-13bba96c77a4 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:11.299213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0c5e2e1c-b5ec-4f57-b218-13bba96c77a4 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1359 microversion: 2.1 time: 0.169799 May 26 17:04:11.299213 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 596/1199] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:11 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:12.314005 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-528bafb0-a25d-46c7-86bf-ffb128965834 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:12.314654 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-528bafb0-a25d-46c7-86bf-ffb128965834 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:12.317296 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:12.318456 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=8 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:12.328304 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-528bafb0-a25d-46c7-86bf-ffb128965834 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:12.328304 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-528bafb0-a25d-46c7-86bf-ffb128965834 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:12.328304 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-528bafb0-a25d-46c7-86bf-ffb128965834 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:12.328304 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-528bafb0-a25d-46c7-86bf-ffb128965834 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:12.459051 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-528bafb0-a25d-46c7-86bf-ffb128965834 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:12.466634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-528bafb0-a25d-46c7-86bf-ffb128965834 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1359 microversion: 2.1 time: 0.156564 May 26 17:04:12.468889 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 604/1200] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:12 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:13.483842 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-d72b58af-e35d-4b78-9281-e54e2f7bc41d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:13.484493 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-d72b58af-e35d-4b78-9281-e54e2f7bc41d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:13.491326 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d72b58af-e35d-4b78-9281-e54e2f7bc41d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:13.491774 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d72b58af-e35d-4b78-9281-e54e2f7bc41d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:13.492555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d72b58af-e35d-4b78-9281-e54e2f7bc41d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:13.492994 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-d72b58af-e35d-4b78-9281-e54e2f7bc41d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:13.626834 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-d72b58af-e35d-4b78-9281-e54e2f7bc41d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:13.634896 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-d72b58af-e35d-4b78-9281-e54e2f7bc41d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1359 microversion: 2.1 time: 0.154914 May 26 17:04:13.635463 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 597/1201] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:13 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:14.651940 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c47e9e98-5982-4710-ac86-1a66759ddd8e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:14.653251 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c47e9e98-5982-4710-ac86-1a66759ddd8e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:14.662433 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c47e9e98-5982-4710-ac86-1a66759ddd8e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:14.662898 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c47e9e98-5982-4710-ac86-1a66759ddd8e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:14.663999 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c47e9e98-5982-4710-ac86-1a66759ddd8e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:14.664446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c47e9e98-5982-4710-ac86-1a66759ddd8e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:14.807963 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c47e9e98-5982-4710-ac86-1a66759ddd8e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:14.815527 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c47e9e98-5982-4710-ac86-1a66759ddd8e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1359 microversion: 2.1 time: 0.168137 May 26 17:04:14.816096 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 605/1202] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:14 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:15.833612 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9ea417b1-9b6a-4e07-a72f-aaf462e1b5d0 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:15.834437 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9ea417b1-9b6a-4e07-a72f-aaf462e1b5d0 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:15.840752 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ea417b1-9b6a-4e07-a72f-aaf462e1b5d0 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:15.841202 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ea417b1-9b6a-4e07-a72f-aaf462e1b5d0 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:15.842019 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ea417b1-9b6a-4e07-a72f-aaf462e1b5d0 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:15.842541 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9ea417b1-9b6a-4e07-a72f-aaf462e1b5d0 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:15.979137 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9ea417b1-9b6a-4e07-a72f-aaf462e1b5d0 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:15.986783 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9ea417b1-9b6a-4e07-a72f-aaf462e1b5d0 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1359 microversion: 2.1 time: 0.157777 May 26 17:04:15.987352 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 598/1203] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:15 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:17.004801 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1f963bcb-2dd8-48a7-88fd-afb9610b0732 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:17.005451 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1f963bcb-2dd8-48a7-88fd-afb9610b0732 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:17.012033 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1f963bcb-2dd8-48a7-88fd-afb9610b0732 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:17.012497 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1f963bcb-2dd8-48a7-88fd-afb9610b0732 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:17.013381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1f963bcb-2dd8-48a7-88fd-afb9610b0732 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:17.013830 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1f963bcb-2dd8-48a7-88fd-afb9610b0732 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:17.148314 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1f963bcb-2dd8-48a7-88fd-afb9610b0732 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:17.156217 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-1f963bcb-2dd8-48a7-88fd-afb9610b0732 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1359 microversion: 2.1 time: 0.156067 May 26 17:04:17.156788 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 606/1204] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:16 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:18.173926 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-c0a83f35-da74-48af-9123-b4f3d924663a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:18.174610 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-c0a83f35-da74-48af-9123-b4f3d924663a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:18.181870 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0a83f35-da74-48af-9123-b4f3d924663a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:18.182321 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0a83f35-da74-48af-9123-b4f3d924663a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:18.183116 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0a83f35-da74-48af-9123-b4f3d924663a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:18.183560 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-c0a83f35-da74-48af-9123-b4f3d924663a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:18.326245 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-c0a83f35-da74-48af-9123-b4f3d924663a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:18.333765 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-c0a83f35-da74-48af-9123-b4f3d924663a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1359 microversion: 2.1 time: 0.164006 May 26 17:04:18.334336 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 599/1205] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:18 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:18.669690 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-2fd4417a-e9bd-47c6-a808-281d00768b69 req-2d5167a2-2440-4c93-81fc-fb3cff85b497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6", "name": "network-vif-plugged", "status": "completed", "tag": "2cf5870a-e439-43e4-845e-634e2e36bb39"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:04:18.677948 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-2fd4417a-e9bd-47c6-a808-281d00768b69 req-2d5167a2-2440-4c93-81fc-fb3cff85b497 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:18.678403 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-2fd4417a-e9bd-47c6-a808-281d00768b69 req-2d5167a2-2440-4c93-81fc-fb3cff85b497 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:18.690237 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-2fd4417a-e9bd-47c6-a808-281d00768b69 req-2d5167a2-2440-4c93-81fc-fb3cff85b497 service nova] Creating event network-vif-plugged:2cf5870a-e439-43e4-845e-634e2e36bb39 for instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 on hv-cinder-83607 May 26 17:04:18.697281 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-2fd4417a-e9bd-47c6-a808-281d00768b69 req-2d5167a2-2440-4c93-81fc-fb3cff85b497 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088123 May 26 17:04:18.698199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 607/1206] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:04:19.351204 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-b4779011-4109-4943-b273-83ced4d860b5 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:19.351972 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-b4779011-4109-4943-b273-83ced4d860b5 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:19.358526 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b4779011-4109-4943-b273-83ced4d860b5 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:19.358979 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b4779011-4109-4943-b273-83ced4d860b5 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:19.359754 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b4779011-4109-4943-b273-83ced4d860b5 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:19.360196 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-b4779011-4109-4943-b273-83ced4d860b5 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:19.490531 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-b4779011-4109-4943-b273-83ced4d860b5 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:19.498149 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-b4779011-4109-4943-b273-83ced4d860b5 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1359 microversion: 2.1 time: 0.151141 May 26 17:04:19.498726 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 600/1207] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:19 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:20.516350 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a91f57a6-dc82-4cd1-85e6-b3c3ffa115cc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:20.517072 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a91f57a6-dc82-4cd1-85e6-b3c3ffa115cc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:20.524290 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a91f57a6-dc82-4cd1-85e6-b3c3ffa115cc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:20.524731 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a91f57a6-dc82-4cd1-85e6-b3c3ffa115cc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:20.525597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a91f57a6-dc82-4cd1-85e6-b3c3ffa115cc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:20.526029 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a91f57a6-dc82-4cd1-85e6-b3c3ffa115cc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:20.678893 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a91f57a6-dc82-4cd1-85e6-b3c3ffa115cc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:20.689874 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a91f57a6-dc82-4cd1-85e6-b3c3ffa115cc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1549 microversion: 2.1 time: 0.177934 May 26 17:04:20.691543 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 608/1208] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:20 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1549 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:20.707357 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-108b7e25-dd6d-4b6e-87a2-abb3d47a4e11 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:20.707975 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-108b7e25-dd6d-4b6e-87a2-abb3d47a4e11 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:20.714602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-108b7e25-dd6d-4b6e-87a2-abb3d47a4e11 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:20.715059 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-108b7e25-dd6d-4b6e-87a2-abb3d47a4e11 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:20.715820 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-108b7e25-dd6d-4b6e-87a2-abb3d47a4e11 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:20.716253 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-108b7e25-dd6d-4b6e-87a2-abb3d47a4e11 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:20.858946 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-108b7e25-dd6d-4b6e-87a2-abb3d47a4e11 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:20.867375 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-108b7e25-dd6d-4b6e-87a2-abb3d47a4e11 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1549 microversion: 2.1 time: 0.163828 May 26 17:04:20.867960 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 601/1209] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:20 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:20.884860 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-4790866d-fa7b-49c3-961b-b8fde32d5f4c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:20.898153 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-4790866d-fa7b-49c3-961b-b8fde32d5f4c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:20.898153 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-4790866d-fa7b-49c3-961b-b8fde32d5f4c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Searching by: {'deleted': False, 'project_id': '0087e93bc2524a29b22a4adedec49ea6'} {{(pid=124836) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 17:04:20.898153 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4790866d-fa7b-49c3-961b-b8fde32d5f4c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:20.898536 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4790866d-fa7b-49c3-961b-b8fde32d5f4c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:20.898536 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4790866d-fa7b-49c3-961b-b8fde32d5f4c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:20.898536 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-4790866d-fa7b-49c3-961b-b8fde32d5f4c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:20.990522 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.multi_cell_list [None req-4790866d-fa7b-49c3-961b-b8fde32d5f4c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124836) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 17:04:21.085130 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-4790866d-fa7b-49c3-961b-b8fde32d5f4c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204292 May 26 17:04:21.085752 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 609/1210] 10.222.0.48 () {58 vars in 1124 bytes} [Thu May 26 17:04:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:04:21.095808 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9c9c369b-fb13-4bc3-86c5-745b25d67b0f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:21.096424 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9c9c369b-fb13-4bc3-86c5-745b25d67b0f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:21.103692 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9c9c369b-fb13-4bc3-86c5-745b25d67b0f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:21.104149 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9c9c369b-fb13-4bc3-86c5-745b25d67b0f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:21.104921 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9c9c369b-fb13-4bc3-86c5-745b25d67b0f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:21.105424 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9c9c369b-fb13-4bc3-86c5-745b25d67b0f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:21.231081 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9c9c369b-fb13-4bc3-86c5-745b25d67b0f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:21.239303 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9c9c369b-fb13-4bc3-86c5-745b25d67b0f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1549 microversion: 2.1 time: 0.147305 May 26 17:04:21.239887 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 602/1211] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:21 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1549 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:23.462458 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-8ad296f1-1604-4f1b-a7be-ccc363e69792 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "162bb772-bf57-423a-ae43-fe423c4e2c02"}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:04:23.463584 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-8ad296f1-1604-4f1b-a7be-ccc363e69792 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:23.470492 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ad296f1-1604-4f1b-a7be-ccc363e69792 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:23.470952 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ad296f1-1604-4f1b-a7be-ccc363e69792 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:23.471734 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ad296f1-1604-4f1b-a7be-ccc363e69792 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:23.472822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-8ad296f1-1604-4f1b-a7be-ccc363e69792 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:24.556700 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-8ad296f1-1604-4f1b-a7be-ccc363e69792 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "POST /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.098372 May 26 17:04:24.557521 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 610/1212] 10.222.0.48 () {60 vars in 1322 bytes} [Thu May 26 17:04:23 2022] POST /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/os-volume_attachments => generated 194 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:04:33.299132 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4aa6753d-c099-4a27-8106-6cf7992bd0fc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:33.299904 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4aa6753d-c099-4a27-8106-6cf7992bd0fc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:33.303079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:33.303982 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=66 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:33.310374 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4aa6753d-c099-4a27-8106-6cf7992bd0fc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:33.310987 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4aa6753d-c099-4a27-8106-6cf7992bd0fc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:33.311977 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4aa6753d-c099-4a27-8106-6cf7992bd0fc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:33.312561 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4aa6753d-c099-4a27-8106-6cf7992bd0fc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:33.480273 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-4aa6753d-c099-4a27-8106-6cf7992bd0fc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:33.490133 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4aa6753d-c099-4a27-8106-6cf7992bd0fc tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1595 microversion: 2.1 time: 0.195618 May 26 17:04:33.490640 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 603/1213] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:33 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1595 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:36.193806 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell0:SELECT=2 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:36.195683 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:36.197741 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:04:36.355634 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-200d5e35-96b1-4f5a-8b80-558aec5b6f01 req-8e812ed4-5473-47db-805c-66e11310c3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6", "tag": "2cf5870a-e439-43e4-845e-634e2e36bb39"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:04:36.370334 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-200d5e35-96b1-4f5a-8b80-558aec5b6f01 req-8e812ed4-5473-47db-805c-66e11310c3a3 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:36.371144 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-200d5e35-96b1-4f5a-8b80-558aec5b6f01 req-8e812ed4-5473-47db-805c-66e11310c3a3 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:36.395153 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-200d5e35-96b1-4f5a-8b80-558aec5b6f01 req-8e812ed4-5473-47db-805c-66e11310c3a3 service nova] Creating event network-changed:2cf5870a-e439-43e4-845e-634e2e36bb39 for instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 on hv-cinder-83607 May 26 17:04:36.404879 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-200d5e35-96b1-4f5a-8b80-558aec5b6f01 req-8e812ed4-5473-47db-805c-66e11310c3a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211745 May 26 17:04:36.406627 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 611/1214] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:04:39.540992 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f33d8f39-20da-49b8-89dd-88b7112d1608 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1889991375"}} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:04:39.541694 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f33d8f39-20da-49b8-89dd-88b7112d1608 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:39.549343 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f33d8f39-20da-49b8-89dd-88b7112d1608 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:39.549845 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f33d8f39-20da-49b8-89dd-88b7112d1608 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:39.550652 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f33d8f39-20da-49b8-89dd-88b7112d1608 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:39.551097 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f33d8f39-20da-49b8-89dd-88b7112d1608 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:39.743043 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.network.security_group_api [None req-f33d8f39-20da-49b8-89dd-88b7112d1608 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Adding security group 525113b5-bd41-4b93-bc38-ed78efeb9e4f to port 2cf5870a-e439-43e4-845e-634e2e36bb39 May 26 17:04:40.543505 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f33d8f39-20da-49b8-89dd-88b7112d1608 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "POST /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/action" status: 202 len: 0 microversion: 2.1 time: 1.007140 May 26 17:04:40.545117 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 604/1215] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 26 17:04:39 2022] POST /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/action => generated 0 bytes in 1010 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:04:40.574854 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-03e56784-5bcb-4c2b-9f81-d6ba0741b927 req-3b13df44-65ed-4d10-972f-499ffa9b21ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6", "tag": "2cf5870a-e439-43e4-845e-634e2e36bb39"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:04:40.577199 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-ceb700fc-6d86-4e37-8921-86fbb443f96d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:40.578686 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-ceb700fc-6d86-4e37-8921-86fbb443f96d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:40.588471 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ceb700fc-6d86-4e37-8921-86fbb443f96d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:40.589489 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ceb700fc-6d86-4e37-8921-86fbb443f96d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:40.590825 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ceb700fc-6d86-4e37-8921-86fbb443f96d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:40.591672 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-ceb700fc-6d86-4e37-8921-86fbb443f96d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:40.604344 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-03e56784-5bcb-4c2b-9f81-d6ba0741b927 req-3b13df44-65ed-4d10-972f-499ffa9b21ed service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:40.605495 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-03e56784-5bcb-4c2b-9f81-d6ba0741b927 req-3b13df44-65ed-4d10-972f-499ffa9b21ed service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:40.631162 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-03e56784-5bcb-4c2b-9f81-d6ba0741b927 req-3b13df44-65ed-4d10-972f-499ffa9b21ed service nova] Creating event network-changed:2cf5870a-e439-43e4-845e-634e2e36bb39 for instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 on hv-cinder-83607 May 26 17:04:40.641720 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-03e56784-5bcb-4c2b-9f81-d6ba0741b927 req-3b13df44-65ed-4d10-972f-499ffa9b21ed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073576 May 26 17:04:40.646863 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 605/1216] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:04:40.893686 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-ceb700fc-6d86-4e37-8921-86fbb443f96d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:40.912210 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-ceb700fc-6d86-4e37-8921-86fbb443f96d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1761 microversion: 2.1 time: 0.359293 May 26 17:04:40.913563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 612/1217] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:40 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1761 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:43.156094 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bf65ef07-991d-43ec-bab3-88e32fd3178c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:43.157159 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bf65ef07-991d-43ec-bab3-88e32fd3178c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:43.158176 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-62cedffd-f1ef-41b3-b4e2-9eec1ff22962 req-f4ae561d-f50e-4173-8fae-5b4c250b8b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7892d0ad-12f2-4fd6-ab09-771e48e98dd2", "tag": "6a11e212-e4cf-4d6b-95e6-04b99b515738"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:04:43.165482 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf65ef07-991d-43ec-bab3-88e32fd3178c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:43.166092 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf65ef07-991d-43ec-bab3-88e32fd3178c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:43.167290 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf65ef07-991d-43ec-bab3-88e32fd3178c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:43.167870 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf65ef07-991d-43ec-bab3-88e32fd3178c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:43.168583 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-62cedffd-f1ef-41b3-b4e2-9eec1ff22962 req-f4ae561d-f50e-4173-8fae-5b4c250b8b37 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:43.169155 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-62cedffd-f1ef-41b3-b4e2-9eec1ff22962 req-f4ae561d-f50e-4173-8fae-5b4c250b8b37 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:43.183329 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-62cedffd-f1ef-41b3-b4e2-9eec1ff22962 req-f4ae561d-f50e-4173-8fae-5b4c250b8b37 service nova] Creating event network-changed:6a11e212-e4cf-4d6b-95e6-04b99b515738 for instance 7892d0ad-12f2-4fd6-ab09-771e48e98dd2 on hv-cinder-83607 May 26 17:04:43.189529 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-62cedffd-f1ef-41b3-b4e2-9eec1ff22962 req-f4ae561d-f50e-4173-8fae-5b4c250b8b37 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034664 May 26 17:04:43.189822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 613/1218] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:04:43.205774 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bf65ef07-991d-43ec-bab3-88e32fd3178c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:04:43.563960 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bf65ef07-991d-43ec-bab3-88e32fd3178c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 204 len: 0 microversion: 2.1 time: 0.415060 May 26 17:04:43.570635 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 606/1219] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:04:43 2022] DELETE /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:04:43.583270 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-beae6453-68a7-4595-b141-a209634d4a39 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:43.591636 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-beae6453-68a7-4595-b141-a209634d4a39 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:43.598512 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-beae6453-68a7-4595-b141-a209634d4a39 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:43.599066 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-beae6453-68a7-4595-b141-a209634d4a39 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:43.600065 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-beae6453-68a7-4595-b141-a209634d4a39 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:43.600968 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-beae6453-68a7-4595-b141-a209634d4a39 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:43.761930 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-beae6453-68a7-4595-b141-a209634d4a39 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:43.771405 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-beae6453-68a7-4595-b141-a209634d4a39 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1574 microversion: 2.1 time: 0.197675 May 26 17:04:43.772041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 614/1220] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:43 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1574 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:44.790649 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-7cd19eb5-0e52-40f9-bfc7-6950645835cd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:44.791425 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-7cd19eb5-0e52-40f9-bfc7-6950645835cd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:44.799326 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7cd19eb5-0e52-40f9-bfc7-6950645835cd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:44.799875 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7cd19eb5-0e52-40f9-bfc7-6950645835cd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:44.800749 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7cd19eb5-0e52-40f9-bfc7-6950645835cd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:44.801250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-7cd19eb5-0e52-40f9-bfc7-6950645835cd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:44.979755 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-7cd19eb5-0e52-40f9-bfc7-6950645835cd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:44.987949 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-7cd19eb5-0e52-40f9-bfc7-6950645835cd tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1574 microversion: 2.1 time: 0.201803 May 26 17:04:44.988583 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 607/1221] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:44 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1574 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:04:46.008590 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-c3b2b1e7-90da-4d0d-aa44-72030b16e9eb tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:46.009566 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-c3b2b1e7-90da-4d0d-aa44-72030b16e9eb tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:46.016961 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c3b2b1e7-90da-4d0d-aa44-72030b16e9eb tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:46.017544 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c3b2b1e7-90da-4d0d-aa44-72030b16e9eb tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:46.019033 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c3b2b1e7-90da-4d0d-aa44-72030b16e9eb tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:46.019555 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-c3b2b1e7-90da-4d0d-aa44-72030b16e9eb tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:46.056747 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-6ce7208f-b1d8-4362-b4bf-fd44907a6d0b req-8b6de3b3-79fe-4ff4-8f4b-2f1bd8ef785e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7892d0ad-12f2-4fd6-ab09-771e48e98dd2", "name": "network-vif-deleted", "tag": "6a11e212-e4cf-4d6b-95e6-04b99b515738"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:04:46.073621 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-6ce7208f-b1d8-4362-b4bf-fd44907a6d0b req-8b6de3b3-79fe-4ff4-8f4b-2f1bd8ef785e service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:46.075907 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-6ce7208f-b1d8-4362-b4bf-fd44907a6d0b req-8b6de3b3-79fe-4ff4-8f4b-2f1bd8ef785e service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:46.093091 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-6ce7208f-b1d8-4362-b4bf-fd44907a6d0b req-8b6de3b3-79fe-4ff4-8f4b-2f1bd8ef785e service nova] Creating event network-vif-deleted:6a11e212-e4cf-4d6b-95e6-04b99b515738 for instance 7892d0ad-12f2-4fd6-ab09-771e48e98dd2 on hv-cinder-83607 May 26 17:04:46.099713 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-6ce7208f-b1d8-4362-b4bf-fd44907a6d0b req-8b6de3b3-79fe-4ff4-8f4b-2f1bd8ef785e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055053 May 26 17:04:46.100976 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 608/1222] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:04:46.106300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-c3b2b1e7-90da-4d0d-aa44-72030b16e9eb tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:46.120588 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-c3b2b1e7-90da-4d0d-aa44-72030b16e9eb tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1389 microversion: 2.1 time: 0.115627 May 26 17:04:46.121676 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 615/1223] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:46 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1389 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:47.143744 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-8a7ce882-aa4d-4396-8262-e062ae994ebf tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:47.144476 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-8a7ce882-aa4d-4396-8262-e062ae994ebf tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:47.152457 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8a7ce882-aa4d-4396-8262-e062ae994ebf tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:47.152946 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8a7ce882-aa4d-4396-8262-e062ae994ebf tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:47.154019 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8a7ce882-aa4d-4396-8262-e062ae994ebf tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:47.154473 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8a7ce882-aa4d-4396-8262-e062ae994ebf tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:47.192349 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8a7ce882-aa4d-4396-8262-e062ae994ebf tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:47.192810 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-8a7ce882-aa4d-4396-8262-e062ae994ebf tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:47.193318 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-8a7ce882-aa4d-4396-8262-e062ae994ebf tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lazy-loading 'fault' on Instance uuid 7892d0ad-12f2-4fd6-ab09-771e48e98dd2 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:04:47.242888 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-8a7ce882-aa4d-4396-8262-e062ae994ebf tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:47.251237 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-8a7ce882-aa4d-4396-8262-e062ae994ebf tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 200 len: 1229 microversion: 2.1 time: 0.112840 May 26 17:04:47.251839 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 609/1224] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:47 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 1229 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:48.271191 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-24cfb960-38f3-42f5-8b7c-080bcad4c0b0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:48.271844 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-24cfb960-38f3-42f5-8b7c-080bcad4c0b0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 7892d0ad-12f2-4fd6-ab09-771e48e98dd2] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:48.279963 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-24cfb960-38f3-42f5-8b7c-080bcad4c0b0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:48.280528 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-24cfb960-38f3-42f5-8b7c-080bcad4c0b0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:48.281445 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-24cfb960-38f3-42f5-8b7c-080bcad4c0b0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:48.281946 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-24cfb960-38f3-42f5-8b7c-080bcad4c0b0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:48.297863 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-24cfb960-38f3-42f5-8b7c-080bcad4c0b0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] HTTP exception thrown: Instance 7892d0ad-12f2-4fd6-ab09-771e48e98dd2 could not be found. May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-24cfb960-38f3-42f5-8b7c-080bcad4c0b0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Request method failure captured: May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 HTTP/1.1 May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7EqciG3FVPmYaBNltgAFOUknoo_IVWHg0H6qRq7PSAbK6DiazlnULhaRQpohntaLGBnsGJxU0v2uZ6GGVb9R9IUbfCURkBMOhn2UFTS_rtBh1lfwbMLXSNAtDPm69PNeDqvc85E69vfIGqZr_dmARy4HR6y48bWk6cwj_8hAxoqMis May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 895a592d480548ddb6afdb1e7c45ed92 May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-TestVolumeBootPattern-1663250540 May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:04:48.300206 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:04:48.303048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/895a592d480548ddb6afdb1e7c45ed92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/895a592d480548ddb6afdb1e7c45ed92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_895a592d480548ddb6afdb1e7c45ed92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/895a592d480548ddb6afdb1e7c45ed92"}]}] May 26 17:04:48.303048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-TestVolumeBootPattern-1663250540 May 26 17:04:48.303048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 895a592d480548ddb6afdb1e7c45ed92 May 26 17:04:48.303048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-TestVolumeBootPattern-1663250540 May 26 17:04:48.303048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-TestVolumeBootPattern-1663250540-project May 26 17:04:48.303048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:04:48.303048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:04:48.303048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 5d6ddab73db44710bcb5bba4c0cfbcfa May 26 17:04:48.303048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-TestVolumeBootPattern-1663250540-project May 26 17:04:48.303048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:04:48.303048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 7892d0ad-12f2-4fd6-ab09-771e48e98dd2 could not be found. May 26 17:04:48.303048 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '7892d0ad-12f2-4fd6-ab09-771e48e98dd2'} May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7892d0ad-12f2-4fd6-ab09-771e48e98dd2 could not be found. May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:04:48.304812 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7892d0ad-12f2-4fd6-ab09-771e48e98dd2 could not be found. May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7892d0ad-12f2-4fd6-ab09-771e48e98dd2 could not be found. May 26 17:04:48.307876 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:04:48.310133 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-24cfb960-38f3-42f5-8b7c-080bcad4c0b0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Returning 404 to user: Instance 7892d0ad-12f2-4fd6-ab09-771e48e98dd2 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:04:48.310133 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-24cfb960-38f3-42f5-8b7c-080bcad4c0b0 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2" status: 404 len: 111 microversion: 2.1 time: 0.035248 May 26 17:04:48.310133 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 616/1225] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:48 2022] GET /compute/v2.1/servers/7892d0ad-12f2-4fd6-ab09-771e48e98dd2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:04:52.282484 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-bf5e4c06-5ccb-434d-ae51-f9cd8beb5ad3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:52.284058 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bf5e4c06-5ccb-434d-ae51-f9cd8beb5ad3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:52.284328 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [req-33a76aac-3086-4726-a1ad-3ad64c0e40fa req-27827647-00c2-4289-a1a7-f9daee1f441c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ade9148-c198-4b82-af96-a501d8a82235", "tag": "eef9f36a-0b1b-49e3-a5f5-259a5554b87a"}]} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:04:52.296987 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-33a76aac-3086-4726-a1ad-3ad64c0e40fa req-27827647-00c2-4289-a1a7-f9daee1f441c service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:52.297350 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf5e4c06-5ccb-434d-ae51-f9cd8beb5ad3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:52.298204 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [req-33a76aac-3086-4726-a1ad-3ad64c0e40fa req-27827647-00c2-4289-a1a7-f9daee1f441c service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:52.298366 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf5e4c06-5ccb-434d-ae51-f9cd8beb5ad3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:52.299875 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf5e4c06-5ccb-434d-ae51-f9cd8beb5ad3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:52.300749 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-bf5e4c06-5ccb-434d-ae51-f9cd8beb5ad3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:52.339099 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.compute.server_external_events [req-33a76aac-3086-4726-a1ad-3ad64c0e40fa req-27827647-00c2-4289-a1a7-f9daee1f441c service nova] Creating event network-changed:eef9f36a-0b1b-49e3-a5f5-259a5554b87a for instance 3ade9148-c198-4b82-af96-a501d8a82235 on hv-cinder-83607 May 26 17:04:52.347479 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [req-33a76aac-3086-4726-a1ad-3ad64c0e40fa req-27827647-00c2-4289-a1a7-f9daee1f441c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067972 May 26 17:04:52.348554 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 617/1226] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:04:52.353515 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-bf5e4c06-5ccb-434d-ae51-f9cd8beb5ad3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:04:52.921120 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-bf5e4c06-5ccb-434d-ae51-f9cd8beb5ad3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 204 len: 0 microversion: 2.1 time: 0.646522 May 26 17:04:52.922659 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 610/1227] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:04:52 2022] DELETE /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:04:52.943039 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9dcaa5e2-ab12-4fd8-a00c-c1a22a3d8df2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:52.944385 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9dcaa5e2-ab12-4fd8-a00c-c1a22a3d8df2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:52.957399 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dcaa5e2-ab12-4fd8-a00c-c1a22a3d8df2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:52.958644 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dcaa5e2-ab12-4fd8-a00c-c1a22a3d8df2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:52.960179 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dcaa5e2-ab12-4fd8-a00c-c1a22a3d8df2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:52.960960 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9dcaa5e2-ab12-4fd8-a00c-c1a22a3d8df2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:53.173045 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9dcaa5e2-ab12-4fd8-a00c-c1a22a3d8df2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:53.182248 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9dcaa5e2-ab12-4fd8-a00c-c1a22a3d8df2 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1577 microversion: 2.1 time: 0.248039 May 26 17:04:53.182967 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 618/1228] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:52 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1577 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:54.209868 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3ffd9fb8-196f-44af-8bba-4e0fa049be22 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:54.210970 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3ffd9fb8-196f-44af-8bba-4e0fa049be22 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:54.221862 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3ffd9fb8-196f-44af-8bba-4e0fa049be22 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:54.222420 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3ffd9fb8-196f-44af-8bba-4e0fa049be22 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:54.223241 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3ffd9fb8-196f-44af-8bba-4e0fa049be22 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:54.223682 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3ffd9fb8-196f-44af-8bba-4e0fa049be22 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:54.431422 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3ffd9fb8-196f-44af-8bba-4e0fa049be22 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:54.442930 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3ffd9fb8-196f-44af-8bba-4e0fa049be22 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1577 microversion: 2.1 time: 0.238302 May 26 17:04:54.444018 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 611/1229] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:54 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1577 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:04:54.950076 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-6becd273-b8dc-4cf8-8406-24f8f7faca54 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:04:54.951264 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-6becd273-b8dc-4cf8-8406-24f8f7faca54 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:54.961328 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6becd273-b8dc-4cf8-8406-24f8f7faca54 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:54.961956 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6becd273-b8dc-4cf8-8406-24f8f7faca54 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:54.962819 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6becd273-b8dc-4cf8-8406-24f8f7faca54 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:54.963255 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-6becd273-b8dc-4cf8-8406-24f8f7faca54 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:55.245449 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-6becd273-b8dc-4cf8-8406-24f8f7faca54 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "POST /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/action" status: 202 len: 0 microversion: 2.1 time: 0.300008 May 26 17:04:55.249834 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 619/1230] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 26 17:04:54 2022] POST /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:04:55.266446 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-59335758-deb6-43fe-a0c6-5ef50dd854c1 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:55.268125 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-59335758-deb6-43fe-a0c6-5ef50dd854c1 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:55.293249 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59335758-deb6-43fe-a0c6-5ef50dd854c1 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:55.295109 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59335758-deb6-43fe-a0c6-5ef50dd854c1 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:55.296881 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59335758-deb6-43fe-a0c6-5ef50dd854c1 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:55.297722 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-59335758-deb6-43fe-a0c6-5ef50dd854c1 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:55.473153 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-a3200f3a-1490-440c-abdb-660706849235 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:55.475726 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-a3200f3a-1490-440c-abdb-660706849235 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:55.489705 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a3200f3a-1490-440c-abdb-660706849235 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:55.490760 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a3200f3a-1490-440c-abdb-660706849235 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:55.492552 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a3200f3a-1490-440c-abdb-660706849235 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:55.493302 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-a3200f3a-1490-440c-abdb-660706849235 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:55.539366 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-59335758-deb6-43fe-a0c6-5ef50dd854c1 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:55.556096 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-59335758-deb6-43fe-a0c6-5ef50dd854c1 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1753 microversion: 2.1 time: 0.303425 May 26 17:04:55.557678 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 612/1231] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:55 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1753 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:55.604791 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-a3200f3a-1490-440c-abdb-660706849235 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:55.620135 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-a3200f3a-1490-440c-abdb-660706849235 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1390 microversion: 2.1 time: 0.159553 May 26 17:04:55.621235 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 620/1232] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:55 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:55.661775 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-a716eb5b-74f2-4af4-9e4c-a4873a7092ee req-f3e6f9e0-b295-4ad4-87ef-397935f772d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ade9148-c198-4b82-af96-a501d8a82235", "name": "network-vif-deleted", "tag": "eef9f36a-0b1b-49e3-a5f5-259a5554b87a"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:04:55.676062 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-a716eb5b-74f2-4af4-9e4c-a4873a7092ee req-f3e6f9e0-b295-4ad4-87ef-397935f772d0 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:55.676772 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-a716eb5b-74f2-4af4-9e4c-a4873a7092ee req-f3e6f9e0-b295-4ad4-87ef-397935f772d0 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:55.695933 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-a716eb5b-74f2-4af4-9e4c-a4873a7092ee req-f3e6f9e0-b295-4ad4-87ef-397935f772d0 service nova] Creating event network-vif-deleted:eef9f36a-0b1b-49e3-a5f5-259a5554b87a for instance 3ade9148-c198-4b82-af96-a501d8a82235 on hv-cinder-83607 May 26 17:04:55.701355 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-a716eb5b-74f2-4af4-9e4c-a4873a7092ee req-f3e6f9e0-b295-4ad4-87ef-397935f772d0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045642 May 26 17:04:55.702451 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 613/1233] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:04:56.583002 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-5eed2394-14dd-4878-9fdc-7120a4695a1c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:56.583920 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-5eed2394-14dd-4878-9fdc-7120a4695a1c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:56.591688 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5eed2394-14dd-4878-9fdc-7120a4695a1c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:56.592135 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5eed2394-14dd-4878-9fdc-7120a4695a1c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:56.592914 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5eed2394-14dd-4878-9fdc-7120a4695a1c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:56.593385 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-5eed2394-14dd-4878-9fdc-7120a4695a1c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:56.647956 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-a5383475-558a-406c-8cb3-0998856a3ef8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:56.649151 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-a5383475-558a-406c-8cb3-0998856a3ef8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:56.657557 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5383475-558a-406c-8cb3-0998856a3ef8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:56.658214 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5383475-558a-406c-8cb3-0998856a3ef8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:56.659297 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5383475-558a-406c-8cb3-0998856a3ef8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:56.659949 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5383475-558a-406c-8cb3-0998856a3ef8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:56.708567 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5383475-558a-406c-8cb3-0998856a3ef8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:56.710930 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-a5383475-558a-406c-8cb3-0998856a3ef8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:56.711582 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.objects.instance [None req-a5383475-558a-406c-8cb3-0998856a3ef8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lazy-loading 'fault' on Instance uuid 3ade9148-c198-4b82-af96-a501d8a82235 {{(pid=124837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:04:56.806268 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-a5383475-558a-406c-8cb3-0998856a3ef8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6ddab73db44710bcb5bba4c0cfbcfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '895a592d480548ddb6afdb1e7c45ed92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:56.816616 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-a5383475-558a-406c-8cb3-0998856a3ef8 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 200 len: 1230 microversion: 2.1 time: 0.175290 May 26 17:04:56.817299 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 614/1234] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:56 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 1230 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:04:56.853246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-5eed2394-14dd-4878-9fdc-7120a4695a1c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:56.862562 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-5eed2394-14dd-4878-9fdc-7120a4695a1c tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1758 microversion: 2.1 time: 0.284345 May 26 17:04:56.863218 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 621/1235] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:56 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1758 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:04:57.834633 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4b784a83-2ec0-435c-867c-98bfa68e2c8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:57.835429 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-4b784a83-2ec0-435c-867c-98bfa68e2c8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 3ade9148-c198-4b82-af96-a501d8a82235] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:57.842596 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4b784a83-2ec0-435c-867c-98bfa68e2c8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:57.843049 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4b784a83-2ec0-435c-867c-98bfa68e2c8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:57.843849 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4b784a83-2ec0-435c-867c-98bfa68e2c8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:57.844297 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-4b784a83-2ec0-435c-867c-98bfa68e2c8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:57.868846 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-4b784a83-2ec0-435c-867c-98bfa68e2c8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] HTTP exception thrown: Instance 3ade9148-c198-4b82-af96-a501d8a82235 could not be found. May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4b784a83-2ec0-435c-867c-98bfa68e2c8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Request method failure captured: May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 HTTP/1.1 May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7EqciG3FVPmYaBNltgAFOUknoo_IVWHg0H6qRq7PSAbK6DiazlnULhaRQpohntaLGBnsGJxU0v2uZ6GGVb9R9IUbfCURkBMOhn2UFTS_rtBh1lfwbMLXSNAtDPm69PNeDqvc85E69vfIGqZr_dmARy4HR6y48bWk6cwj_8hAxoqMis May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 895a592d480548ddb6afdb1e7c45ed92 May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-TestVolumeBootPattern-1663250540 May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:04:57.872156 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:04:57.875516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/895a592d480548ddb6afdb1e7c45ed92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/895a592d480548ddb6afdb1e7c45ed92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_895a592d480548ddb6afdb1e7c45ed92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/895a592d480548ddb6afdb1e7c45ed92"}]}] May 26 17:04:57.875516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-TestVolumeBootPattern-1663250540 May 26 17:04:57.875516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 895a592d480548ddb6afdb1e7c45ed92 May 26 17:04:57.875516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-TestVolumeBootPattern-1663250540 May 26 17:04:57.875516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-TestVolumeBootPattern-1663250540-project May 26 17:04:57.875516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:04:57.875516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:04:57.875516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: 5d6ddab73db44710bcb5bba4c0cfbcfa May 26 17:04:57.875516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-TestVolumeBootPattern-1663250540-project May 26 17:04:57.875516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 17:04:57.875516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance 3ade9148-c198-4b82-af96-a501d8a82235 could not be found. May 26 17:04:57.875516 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': '3ade9148-c198-4b82-af96-a501d8a82235'} May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ade9148-c198-4b82-af96-a501d8a82235 could not be found. May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:04:57.876521 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ade9148-c198-4b82-af96-a501d8a82235 could not be found. May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ade9148-c198-4b82-af96-a501d8a82235 could not be found. May 26 17:04:57.878708 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:04:57.880139 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-4b784a83-2ec0-435c-867c-98bfa68e2c8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Returning 404 to user: Instance 3ade9148-c198-4b82-af96-a501d8a82235 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:04:57.880139 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-4b784a83-2ec0-435c-867c-98bfa68e2c8f tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235" status: 404 len: 111 microversion: 2.1 time: 0.043868 May 26 17:04:57.880919 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 615/1236] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:57 2022] GET /compute/v2.1/servers/3ade9148-c198-4b82-af96-a501d8a82235 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:04:57.885973 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-bdef8c73-4795-48fa-b419-82c0c6fd057b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:57.886783 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-bdef8c73-4795-48fa-b419-82c0c6fd057b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:57.895279 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bdef8c73-4795-48fa-b419-82c0c6fd057b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:57.895741 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bdef8c73-4795-48fa-b419-82c0c6fd057b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:57.896684 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bdef8c73-4795-48fa-b419-82c0c6fd057b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:57.897129 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-bdef8c73-4795-48fa-b419-82c0c6fd057b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:58.177910 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-bdef8c73-4795-48fa-b419-82c0c6fd057b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:58.187962 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-bdef8c73-4795-48fa-b419-82c0c6fd057b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1758 microversion: 2.1 time: 0.308603 May 26 17:04:58.188666 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 622/1237] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:57 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1758 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:04:58.631043 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-39c2a854-c379-4fce-8c83-def0ef41806c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:58.631560 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-39c2a854-c379-4fce-8c83-def0ef41806c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:58.638650 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-39c2a854-c379-4fce-8c83-def0ef41806c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:58.639831 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-39c2a854-c379-4fce-8c83-def0ef41806c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:58.640276 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-39c2a854-c379-4fce-8c83-def0ef41806c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:58.640743 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-39c2a854-c379-4fce-8c83-def0ef41806c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:58.657601 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-39c2a854-c379-4fce-8c83-def0ef41806c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] HTTP exception thrown: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-39c2a854-c379-4fce-8c83-def0ef41806c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Request method failure captured: May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: DELETE /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 HTTP/1.1 May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7EqciG3FVPmYaBNltgAFOUknoo_IVWHg0H6qRq7PSAbK6DiazlnULhaRQpohntaLGBnsGJxU0v2uZ6GGVb9R9IUbfCURkBMOhn2UFTS_rtBh1lfwbMLXSNAtDPm69PNeDqvc85E69vfIGqZr_dmARy4HR6y48bWk6cwj_8hAxoqMis May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 895a592d480548ddb6afdb1e7c45ed92 May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-TestVolumeBootPattern-1663250540 May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:04:58.659830 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:04:58.663064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/895a592d480548ddb6afdb1e7c45ed92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/895a592d480548ddb6afdb1e7c45ed92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_895a592d480548ddb6afdb1e7c45ed92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/895a592d480548ddb6afdb1e7c45ed92"}]}] May 26 17:04:58.663064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-TestVolumeBootPattern-1663250540 May 26 17:04:58.663064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 895a592d480548ddb6afdb1e7c45ed92 May 26 17:04:58.663064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-TestVolumeBootPattern-1663250540 May 26 17:04:58.663064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-TestVolumeBootPattern-1663250540-project May 26 17:04:58.663064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:04:58.663064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:04:58.663064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: 5d6ddab73db44710bcb5bba4c0cfbcfa May 26 17:04:58.663064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-TestVolumeBootPattern-1663250540-project May 26 17:04:58.663064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 17:04:58.663064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. May 26 17:04:58.663064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': '69fcc029-dd46-485e-8058-9d577bb0e654'} May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:04:58.664794 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. May 26 17:04:58.667771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:04:58.670728 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-39c2a854-c379-4fce-8c83-def0ef41806c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Returning 404 to user: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:04:58.670728 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-39c2a854-c379-4fce-8c83-def0ef41806c tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "DELETE /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 404 len: 111 microversion: 2.1 time: 0.034578 May 26 17:04:58.670728 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 616/1238] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:04:58 2022] DELETE /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 17:04:58.671622 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-006851c1-8c8e-4f83-a06c-a27301fdb3e7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:58.672263 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-006851c1-8c8e-4f83-a06c-a27301fdb3e7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] [instance: 69fcc029-dd46-485e-8058-9d577bb0e654] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:58.679861 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-006851c1-8c8e-4f83-a06c-a27301fdb3e7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:58.680474 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-006851c1-8c8e-4f83-a06c-a27301fdb3e7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:58.681488 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-006851c1-8c8e-4f83-a06c-a27301fdb3e7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:58.682033 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-006851c1-8c8e-4f83-a06c-a27301fdb3e7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:58.697865 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-006851c1-8c8e-4f83-a06c-a27301fdb3e7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] HTTP exception thrown: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-006851c1-8c8e-4f83-a06c-a27301fdb3e7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Request method failure captured: May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 HTTP/1.1 May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7EqciG3FVPmYaBNltgAFOUknoo_IVWHg0H6qRq7PSAbK6DiazlnULhaRQpohntaLGBnsGJxU0v2uZ6GGVb9R9IUbfCURkBMOhn2UFTS_rtBh1lfwbMLXSNAtDPm69PNeDqvc85E69vfIGqZr_dmARy4HR6y48bWk6cwj_8hAxoqMis May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 895a592d480548ddb6afdb1e7c45ed92 May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-TestVolumeBootPattern-1663250540 May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:04:58.699563 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:04:58.702084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/895a592d480548ddb6afdb1e7c45ed92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/895a592d480548ddb6afdb1e7c45ed92"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_895a592d480548ddb6afdb1e7c45ed92", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/895a592d480548ddb6afdb1e7c45ed92"}]}] May 26 17:04:58.702084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-TestVolumeBootPattern-1663250540 May 26 17:04:58.702084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 895a592d480548ddb6afdb1e7c45ed92 May 26 17:04:58.702084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-TestVolumeBootPattern-1663250540 May 26 17:04:58.702084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-TestVolumeBootPattern-1663250540-project May 26 17:04:58.702084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:04:58.702084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:04:58.702084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: 5d6ddab73db44710bcb5bba4c0cfbcfa May 26 17:04:58.702084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-TestVolumeBootPattern-1663250540-project May 26 17:04:58.702084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:04:58.702084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. May 26 17:04:58.702084 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'id': '69fcc029-dd46-485e-8058-9d577bb0e654'} May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:04:58.703435 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. May 26 17:04:58.705446 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:04:58.707552 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-006851c1-8c8e-4f83-a06c-a27301fdb3e7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Returning 404 to user: Instance 69fcc029-dd46-485e-8058-9d577bb0e654 could not be found. {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:04:58.707552 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-006851c1-8c8e-4f83-a06c-a27301fdb3e7 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654" status: 404 len: 111 microversion: 2.1 time: 0.033939 May 26 17:04:58.707552 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 623/1239] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:58 2022] GET /compute/v2.1/servers/69fcc029-dd46-485e-8058-9d577bb0e654 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:04:59.211332 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-0b525207-ca15-471c-9e55-a071d2fd6d2a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:04:59.212565 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-0b525207-ca15-471c-9e55-a071d2fd6d2a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:04:59.226094 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b525207-ca15-471c-9e55-a071d2fd6d2a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:59.226900 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b525207-ca15-471c-9e55-a071d2fd6d2a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:59.228318 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b525207-ca15-471c-9e55-a071d2fd6d2a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:04:59.229230 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-0b525207-ca15-471c-9e55-a071d2fd6d2a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:04:59.453555 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-0b525207-ca15-471c-9e55-a071d2fd6d2a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:04:59.466171 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-0b525207-ca15-471c-9e55-a071d2fd6d2a tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1758 microversion: 2.1 time: 0.261960 May 26 17:04:59.466784 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 617/1240] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:04:59 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1758 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:00.412737 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-eb6397d4-9ac1-446b-b437-f7a62a9de7c3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] Calling method '.version_select at 0x7fbe80601f70>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:00.489058 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-adc465e5-1401-4ffd-b99d-c998874320c2 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:00.490203 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-adc465e5-1401-4ffd-b99d-c998874320c2 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:00.502658 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-adc465e5-1401-4ffd-b99d-c998874320c2 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:00.502964 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-eb6397d4-9ac1-446b-b437-f7a62a9de7c3 tempest-TestVolumeBootPattern-1663250540 tempest-TestVolumeBootPattern-1663250540-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-787864708" status: 202 len: 0 microversion: 2.1 time: 0.093690 May 26 17:05:00.503447 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-adc465e5-1401-4ffd-b99d-c998874320c2 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:00.504443 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 624/1241] 10.222.0.48 () {58 vars in 1259 bytes} [Thu May 26 17:05:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-787864708 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:05:00.504865 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-adc465e5-1401-4ffd-b99d-c998874320c2 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:00.505654 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-adc465e5-1401-4ffd-b99d-c998874320c2 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:00.755576 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-adc465e5-1401-4ffd-b99d-c998874320c2 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:00.766215 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-adc465e5-1401-4ffd-b99d-c998874320c2 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1758 microversion: 2.1 time: 0.284689 May 26 17:05:00.767071 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 618/1242] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:05:00 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1758 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:01.789169 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-9e96981c-bb2a-43c3-99c9-d232f29272cf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:01.790348 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-9e96981c-bb2a-43c3-99c9-d232f29272cf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:01.804250 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9e96981c-bb2a-43c3-99c9-d232f29272cf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:01.805049 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9e96981c-bb2a-43c3-99c9-d232f29272cf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:01.806506 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9e96981c-bb2a-43c3-99c9-d232f29272cf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:01.807288 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-9e96981c-bb2a-43c3-99c9-d232f29272cf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:02.051058 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-9e96981c-bb2a-43c3-99c9-d232f29272cf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:02.065396 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-9e96981c-bb2a-43c3-99c9-d232f29272cf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1758 microversion: 2.1 time: 0.283675 May 26 17:05:02.066617 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 625/1243] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:05:01 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1758 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:03.085917 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-892d0549-dd54-4053-8560-802dbf7aa7bd tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:03.086647 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-892d0549-dd54-4053-8560-802dbf7aa7bd tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:03.096536 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-892d0549-dd54-4053-8560-802dbf7aa7bd tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:03.098520 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-892d0549-dd54-4053-8560-802dbf7aa7bd tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:03.101030 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-892d0549-dd54-4053-8560-802dbf7aa7bd tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:03.102705 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-892d0549-dd54-4053-8560-802dbf7aa7bd tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:03.139600 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:03.302340 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-892d0549-dd54-4053-8560-802dbf7aa7bd tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:03.318658 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-892d0549-dd54-4053-8560-802dbf7aa7bd tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1758 microversion: 2.1 time: 0.238692 May 26 17:05:03.319752 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 619/1244] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:05:03 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1758 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 17:05:04.345108 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1241707d-0d96-4719-9de3-323aa46e1778 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:04.348240 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1241707d-0d96-4719-9de3-323aa46e1778 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:04.363041 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1241707d-0d96-4719-9de3-323aa46e1778 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:04.364126 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1241707d-0d96-4719-9de3-323aa46e1778 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:04.365711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1241707d-0d96-4719-9de3-323aa46e1778 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:04.366624 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1241707d-0d96-4719-9de3-323aa46e1778 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:04.586611 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-1241707d-0d96-4719-9de3-323aa46e1778 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:04.596631 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-1241707d-0d96-4719-9de3-323aa46e1778 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1758 microversion: 2.1 time: 0.257314 May 26 17:05:04.600711 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 626/1245] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:05:04 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1758 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:05.623215 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-496f1dd6-50fa-408e-9b46-cff89f0ea61d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:05.625951 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-496f1dd6-50fa-408e-9b46-cff89f0ea61d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:05.639795 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-496f1dd6-50fa-408e-9b46-cff89f0ea61d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:05.652218 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-496f1dd6-50fa-408e-9b46-cff89f0ea61d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:05.652218 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-496f1dd6-50fa-408e-9b46-cff89f0ea61d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:05.652218 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-496f1dd6-50fa-408e-9b46-cff89f0ea61d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:05.883385 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-496f1dd6-50fa-408e-9b46-cff89f0ea61d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:05.893802 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-496f1dd6-50fa-408e-9b46-cff89f0ea61d tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1758 microversion: 2.1 time: 0.282194 May 26 17:05:05.894499 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 620/1246] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:05:05 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1758 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:06.912484 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-b4aba720-97f7-408c-9f11-404b24ea8174 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:06.913387 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-b4aba720-97f7-408c-9f11-404b24ea8174 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:06.922086 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b4aba720-97f7-408c-9f11-404b24ea8174 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:06.922605 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b4aba720-97f7-408c-9f11-404b24ea8174 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:06.923462 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b4aba720-97f7-408c-9f11-404b24ea8174 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:06.923935 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-b4aba720-97f7-408c-9f11-404b24ea8174 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:07.133922 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-b4aba720-97f7-408c-9f11-404b24ea8174 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:07.151619 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-b4aba720-97f7-408c-9f11-404b24ea8174 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1758 microversion: 2.1 time: 0.243188 May 26 17:05:07.153841 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 627/1247] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:05:06 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1758 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:08.177524 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-3412642b-409e-444d-ac8f-21d0329fe612 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:08.179295 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-3412642b-409e-444d-ac8f-21d0329fe612 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:08.187349 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3412642b-409e-444d-ac8f-21d0329fe612 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:08.188087 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3412642b-409e-444d-ac8f-21d0329fe612 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:08.189890 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3412642b-409e-444d-ac8f-21d0329fe612 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:08.190590 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-3412642b-409e-444d-ac8f-21d0329fe612 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:08.394853 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-3412642b-409e-444d-ac8f-21d0329fe612 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:08.405149 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-3412642b-409e-444d-ac8f-21d0329fe612 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1761 microversion: 2.1 time: 0.237346 May 26 17:05:08.405877 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 621/1248] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:05:08 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1761 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:40.767851 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-73f0ab18-1af0-4687-ab64-b568d786d16f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1889991375"}} {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:40.768514 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-73f0ab18-1af0-4687-ab64-b568d786d16f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:40.770618 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:40.771334 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG dbcounter [-] [124836] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124836) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:40.776403 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-73f0ab18-1af0-4687-ab64-b568d786d16f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:40.776863 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-73f0ab18-1af0-4687-ab64-b568d786d16f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:40.777774 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-73f0ab18-1af0-4687-ab64-b568d786d16f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:40.778215 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-73f0ab18-1af0-4687-ab64-b568d786d16f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:40.922863 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.network.security_group_api [None req-73f0ab18-1af0-4687-ab64-b568d786d16f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Removing security group 525113b5-bd41-4b93-bc38-ed78efeb9e4f from port 2cf5870a-e439-43e4-845e-634e2e36bb39 May 26 17:05:41.451973 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-73f0ab18-1af0-4687-ab64-b568d786d16f tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "POST /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/action" status: 202 len: 0 microversion: 2.1 time: 0.688745 May 26 17:05:41.456912 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 628/1249] 10.222.0.48 () {60 vars in 1277 bytes} [Thu May 26 17:05:40 2022] POST /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/action => generated 0 bytes in 691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:05:41.474540 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-b7141041-3c5a-4250-aeb2-8d2504f4f84a req-55f6e3cb-eaf1-4ac1-92d5-d5e6f14ddb60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6", "tag": "2cf5870a-e439-43e4-845e-634e2e36bb39"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:41.486929 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:41.488474 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG dbcounter [-] [124837] Writing DB stats nova_cell1:SELECT=16 {{(pid=124837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:41.491716 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-b7141041-3c5a-4250-aeb2-8d2504f4f84a req-55f6e3cb-eaf1-4ac1-92d5-d5e6f14ddb60 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:41.496319 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-b7141041-3c5a-4250-aeb2-8d2504f4f84a req-55f6e3cb-eaf1-4ac1-92d5-d5e6f14ddb60 service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:41.513443 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-b7141041-3c5a-4250-aeb2-8d2504f4f84a req-55f6e3cb-eaf1-4ac1-92d5-d5e6f14ddb60 service nova] Creating event network-changed:2cf5870a-e439-43e4-845e-634e2e36bb39 for instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 on hv-cinder-83607 May 26 17:05:41.521749 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-b7141041-3c5a-4250-aeb2-8d2504f4f84a req-55f6e3cb-eaf1-4ac1-92d5-d5e6f14ddb60 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052492 May 26 17:05:41.524094 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 622/1250] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:43.254057 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1be5413f-c3ab-49d3-a7eb-224de3ee48bf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:43.254707 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-1be5413f-c3ab-49d3-a7eb-224de3ee48bf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:43.261401 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1be5413f-c3ab-49d3-a7eb-224de3ee48bf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:43.261868 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1be5413f-c3ab-49d3-a7eb-224de3ee48bf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:43.263662 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1be5413f-c3ab-49d3-a7eb-224de3ee48bf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:43.263662 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-1be5413f-c3ab-49d3-a7eb-224de3ee48bf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:43.349550 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-1be5413f-c3ab-49d3-a7eb-224de3ee48bf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lazy-loading 'services' on Instance uuid e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:05:43.543301 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-72efb3f1-2775-4111-bf3f-a2bfbfbd1e1a req-a3b4c8b5-54b5-4d82-9095-e54ea86a6bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6", "tag": "2cf5870a-e439-43e4-845e-634e2e36bb39"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:43.550239 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-72efb3f1-2775-4111-bf3f-a2bfbfbd1e1a req-a3b4c8b5-54b5-4d82-9095-e54ea86a6bce service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:43.550690 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-72efb3f1-2775-4111-bf3f-a2bfbfbd1e1a req-a3b4c8b5-54b5-4d82-9095-e54ea86a6bce service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:43.562937 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-72efb3f1-2775-4111-bf3f-a2bfbfbd1e1a req-a3b4c8b5-54b5-4d82-9095-e54ea86a6bce service nova] Creating event network-changed:2cf5870a-e439-43e4-845e-634e2e36bb39 for instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 on hv-cinder-83607 May 26 17:05:43.568114 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-72efb3f1-2775-4111-bf3f-a2bfbfbd1e1a req-a3b4c8b5-54b5-4d82-9095-e54ea86a6bce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033386 May 26 17:05:43.568967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 623/1251] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 17:05:43.665524 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-1be5413f-c3ab-49d3-a7eb-224de3ee48bf tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/os-volume_attachments/162bb772-bf57-423a-ae43-fe423c4e2c02" status: 202 len: 0 microversion: 2.1 time: 0.416780 May 26 17:05:43.669120 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 629/1252] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 26 17:05:43 2022] DELETE /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/os-volume_attachments/162bb772-bf57-423a-ae43-fe423c4e2c02 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 17:05:43.678763 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-f198ba23-93ee-4eae-aa88-8184dfd6649e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:43.680267 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-f198ba23-93ee-4eae-aa88-8184dfd6649e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:43.687469 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f198ba23-93ee-4eae-aa88-8184dfd6649e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:43.687980 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f198ba23-93ee-4eae-aa88-8184dfd6649e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:43.688786 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f198ba23-93ee-4eae-aa88-8184dfd6649e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:43.689233 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-f198ba23-93ee-4eae-aa88-8184dfd6649e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:43.724167 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-f198ba23-93ee-4eae-aa88-8184dfd6649e tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050369 May 26 17:05:43.725193 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 624/1253] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 17:05:43 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:44.737983 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-94ce161d-0724-4ef3-9b01-f2c5e94da3f4 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:44.739056 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-94ce161d-0724-4ef3-9b01-f2c5e94da3f4 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:44.745470 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94ce161d-0724-4ef3-9b01-f2c5e94da3f4 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:44.745918 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94ce161d-0724-4ef3-9b01-f2c5e94da3f4 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:44.746672 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94ce161d-0724-4ef3-9b01-f2c5e94da3f4 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:44.747102 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-94ce161d-0724-4ef3-9b01-f2c5e94da3f4 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:44.781031 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-94ce161d-0724-4ef3-9b01-f2c5e94da3f4 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048571 May 26 17:05:44.781754 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 630/1254] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 17:05:44 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:45.794379 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-83c2b278-add3-4330-83f1-468e4df56b57 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:45.795347 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-83c2b278-add3-4330-83f1-468e4df56b57 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:45.802148 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83c2b278-add3-4330-83f1-468e4df56b57 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:45.802628 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83c2b278-add3-4330-83f1-468e4df56b57 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:45.803373 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83c2b278-add3-4330-83f1-468e4df56b57 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:45.803808 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-83c2b278-add3-4330-83f1-468e4df56b57 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:45.832515 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-83c2b278-add3-4330-83f1-468e4df56b57 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042392 May 26 17:05:45.833079 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 625/1255] 10.222.0.48 () {58 vars in 1301 bytes} [Thu May 26 17:05:45 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 17:05:45.843635 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e18c958c-844a-46cc-8116-ad5e7c3f1441 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:45.844822 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-e18c958c-844a-46cc-8116-ad5e7c3f1441 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:45.852113 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e18c958c-844a-46cc-8116-ad5e7c3f1441 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:45.852569 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e18c958c-844a-46cc-8116-ad5e7c3f1441 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:45.853388 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e18c958c-844a-46cc-8116-ad5e7c3f1441 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:45.853830 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-e18c958c-844a-46cc-8116-ad5e7c3f1441 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:45.935801 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.wsgi [None req-e18c958c-844a-46cc-8116-ad5e7c3f1441 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] HTTP exception thrown: Instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 is not attached to volume 162bb772-bf57-423a-ae43-fe423c4e2c02 May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e18c958c-844a-46cc-8116-ad5e7c3f1441 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Request method failure captured: May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: request: DELETE /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/os-volume_attachments/162bb772-bf57-423a-ae43-fe423c4e2c02 HTTP/1.1 May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept: application/json May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Accept-Encoding: identity May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Connection: close May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Length: 0 May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Content-Type: application/json May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Host: 10.222.0.48 May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Openstack-System-Scope: None May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: User-Agent: python-urllib3/1.26.9 May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Auth-Token: gAAAAABij7Lq1iHH8FDCrhc11r9YN2p3RfCgXlPwDN5pCe004rxjkdmGPyBS_FFjLRusVJgLRyv7-n1fDJY1OqvGnHhe69FTOLZ6cL_XUHA0KWZRo32ytxTAYnvwZFb_HkQjQs4tq3UwJeeAXsGgoawsMomvPi25DjwK4AdBys6Cl6Tfw6k7RAI May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Id: None May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Domain-Name: None May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Identity-Status: Confirmed May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Is-Admin-Project: True May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Id: default May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Domain-Name: Default May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Id: 0087e93bc2524a29b22a4adedec49ea6 May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Project-Name: tempest-TestMinimumBasicScenario-1457916280 May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Role: member,reader May 26 17:05:45.943597 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Roles: member,reader May 26 17:05:45.946381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0087e93bc2524a29b22a4adedec49ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0087e93bc2524a29b22a4adedec49ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0087e93bc2524a29b22a4adedec49ea6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0087e93bc2524a29b22a4adedec49ea6"}]}] May 26 17:05:45.946381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant: tempest-TestMinimumBasicScenario-1457916280 May 26 17:05:45.946381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Id: 0087e93bc2524a29b22a4adedec49ea6 May 26 17:05:45.946381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1457916280 May 26 17:05:45.946381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User: tempest-TestMinimumBasicScenario-1457916280-project May 26 17:05:45.946381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Id: default May 26 17:05:45.946381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Domain-Name: Default May 26 17:05:45.946381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Id: d4864aa668bd4b3ba45d9570d94d4601 May 26 17:05:45.946381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: X-User-Name: tempest-TestMinimumBasicScenario-1457916280-project May 26 17:05:45.946381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: method: > May 26 17:05:45.946381 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: exception: Instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 is not attached to volume 162bb772-bf57-423a-ae43-fe423c4e2c02 May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: action_args: {'server_id': 'e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6', 'id': '162bb772-bf57-423a-ae43-fe423c4e2c02'} May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 162bb772-bf57-423a-ae43-fe423c4e2c02. May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:05:45.947775 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:05:45.950246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:05:45.950246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 26 17:05:45.950246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 26 17:05:45.950246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 is not attached to volume 162bb772-bf57-423a-ae43-fe423c4e2c02 May 26 17:05:45.950246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:05:45.950246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:45.950246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:05:45.950246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:45.950246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:45.950246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:45.950246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:05:45.950246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:05:45.950246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 is not attached to volume 162bb772-bf57-423a-ae43-fe423c4e2c02 May 26 17:05:45.950246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: ERROR nova.api.openstack.wsgi May 26 17:05:45.950246 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-e18c958c-844a-46cc-8116-ad5e7c3f1441 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Returning 404 to user: Instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 is not attached to volume 162bb772-bf57-423a-ae43-fe423c4e2c02 {{(pid=124836) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:05:45.952204 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-e18c958c-844a-46cc-8116-ad5e7c3f1441 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/os-volume_attachments/162bb772-bf57-423a-ae43-fe423c4e2c02" status: 404 len: 154 microversion: 2.1 time: 0.105898 May 26 17:05:45.952204 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 631/1256] 10.222.0.48 () {58 vars in 1415 bytes} [Thu May 26 17:05:45 2022] DELETE /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6/os-volume_attachments/162bb772-bf57-423a-ae43-fe423c4e2c02 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:05:47.264828 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-28606f88-c2ae-4096-9838-cf2d429bec0b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:47.265422 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-28606f88-c2ae-4096-9838-cf2d429bec0b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:47.272705 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-28606f88-c2ae-4096-9838-cf2d429bec0b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:47.273164 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-28606f88-c2ae-4096-9838-cf2d429bec0b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:47.273998 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-28606f88-c2ae-4096-9838-cf2d429bec0b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:47.274441 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-28606f88-c2ae-4096-9838-cf2d429bec0b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:47.304707 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-28606f88-c2ae-4096-9838-cf2d429bec0b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Going to try to terminate instance {{(pid=124837) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 17:05:47.677063 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-28606f88-c2ae-4096-9838-cf2d429bec0b tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 204 len: 0 microversion: 2.1 time: 0.415531 May 26 17:05:47.677747 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 626/1257] 10.222.0.48 () {58 vars in 1238 bytes} [Thu May 26 17:05:47 2022] DELETE /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 17:05:47.686343 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-3639cc4a-67c7-4f65-83eb-d6b183fe2e31 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:47.686972 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-3639cc4a-67c7-4f65-83eb-d6b183fe2e31 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:47.694626 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3639cc4a-67c7-4f65-83eb-d6b183fe2e31 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:47.695505 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3639cc4a-67c7-4f65-83eb-d6b183fe2e31 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:47.696300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3639cc4a-67c7-4f65-83eb-d6b183fe2e31 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:47.696900 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-3639cc4a-67c7-4f65-83eb-d6b183fe2e31 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:47.843180 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-3639cc4a-67c7-4f65-83eb-d6b183fe2e31 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:47.851987 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-3639cc4a-67c7-4f65-83eb-d6b183fe2e31 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1555 microversion: 2.1 time: 0.169508 May 26 17:05:47.852609 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 632/1258] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:05:47 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:48.870456 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-9a532329-b2ad-4122-8e12-b73395a3e7b8 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:48.871159 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-9a532329-b2ad-4122-8e12-b73395a3e7b8 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:48.878082 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a532329-b2ad-4122-8e12-b73395a3e7b8 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:48.878543 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a532329-b2ad-4122-8e12-b73395a3e7b8 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:48.879365 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a532329-b2ad-4122-8e12-b73395a3e7b8 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:48.879991 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-9a532329-b2ad-4122-8e12-b73395a3e7b8 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:49.017369 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.policy [None req-9a532329-b2ad-4122-8e12-b73395a3e7b8 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124837) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:49.025716 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-9a532329-b2ad-4122-8e12-b73395a3e7b8 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1555 microversion: 2.1 time: 0.159462 May 26 17:05:49.026298 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 627/1259] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:05:48 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:50.044915 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-781f265b-8510-41ca-8a26-4cdc9f589575 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:50.044915 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-781f265b-8510-41ca-8a26-4cdc9f589575 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:50.056727 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-781f265b-8510-41ca-8a26-4cdc9f589575 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:50.057300 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-781f265b-8510-41ca-8a26-4cdc9f589575 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:50.058139 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-781f265b-8510-41ca-8a26-4cdc9f589575 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:50.058650 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-781f265b-8510-41ca-8a26-4cdc9f589575 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:50.199044 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-781f265b-8510-41ca-8a26-4cdc9f589575 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:50.209895 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-781f265b-8510-41ca-8a26-4cdc9f589575 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1555 microversion: 2.1 time: 0.170330 May 26 17:05:50.210698 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 633/1260] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:05:50 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:50.536323 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [req-7e37c842-4a64-46da-9e00-c44e356db269 req-24c23d1f-4209-4e50-814e-e85016f0666a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6", "name": "network-vif-deleted", "tag": "2cf5870a-e439-43e4-845e-634e2e36bb39"}]} {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 17:05:50.552223 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-7e37c842-4a64-46da-9e00-c44e356db269 req-24c23d1f-4209-4e50-814e-e85016f0666a service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:50.552223 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [req-7e37c842-4a64-46da-9e00-c44e356db269 req-24c23d1f-4209-4e50-814e-e85016f0666a service nova] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:50.565150 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.compute.server_external_events [req-7e37c842-4a64-46da-9e00-c44e356db269 req-24c23d1f-4209-4e50-814e-e85016f0666a service nova] Creating event network-vif-deleted:2cf5870a-e439-43e4-845e-634e2e36bb39 for instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 on hv-cinder-83607 May 26 17:05:50.571160 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [req-7e37c842-4a64-46da-9e00-c44e356db269 req-24c23d1f-4209-4e50-814e-e85016f0666a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038232 May 26 17:05:50.571771 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 628/1261] 10.222.0.48 () {64 vars in 1317 bytes} [Thu May 26 17:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 17:05:51.227875 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-f13d4056-0c3a-4389-a8f9-bc704c78cb34 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:51.228484 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.compute.api [None req-f13d4056-0c3a-4389-a8f9-bc704c78cb34 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124836) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:51.236053 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f13d4056-0c3a-4389-a8f9-bc704c78cb34 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:51.236506 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f13d4056-0c3a-4389-a8f9-bc704c78cb34 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:51.237288 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f13d4056-0c3a-4389-a8f9-bc704c78cb34 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:51.237745 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f13d4056-0c3a-4389-a8f9-bc704c78cb34 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:51.268188 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f13d4056-0c3a-4389-a8f9-bc704c78cb34 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:51.268633 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG oslo_concurrency.lockutils [None req-f13d4056-0c3a-4389-a8f9-bc704c78cb34 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124836) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:51.269083 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.objects.instance [None req-f13d4056-0c3a-4389-a8f9-bc704c78cb34 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lazy-loading 'fault' on Instance uuid e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 {{(pid=124836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 17:05:51.315394 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.policy [None req-f13d4056-0c3a-4389-a8f9-bc704c78cb34 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4864aa668bd4b3ba45d9570d94d4601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0087e93bc2524a29b22a4adedec49ea6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124836) authorize /opt/stack/nova/nova/policy.py:199}} May 26 17:05:51.323929 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-f13d4056-0c3a-4389-a8f9-bc704c78cb34 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 200 len: 1349 microversion: 2.1 time: 0.100122 May 26 17:05:51.324524 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 634/1262] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:05:51 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 1349 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 17:05:52.346212 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-dd5e67dc-9db9-45f6-8db0-1a7b64ad7b47 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '>' {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:52.347021 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.compute.api [None req-dd5e67dc-9db9-45f6-8db0-1a7b64ad7b47 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] [instance: e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6] Fetching instance by UUID {{(pid=124837) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 17:05:52.354362 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd5e67dc-9db9-45f6-8db0-1a7b64ad7b47 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:52.354823 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd5e67dc-9db9-45f6-8db0-1a7b64ad7b47 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:52.355602 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd5e67dc-9db9-45f6-8db0-1a7b64ad7b47 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 17:05:52.356040 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG oslo_concurrency.lockutils [None req-dd5e67dc-9db9-45f6-8db0-1a7b64ad7b47 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Lock "c318fc1c-f63e-4318-9beb-7eb6730543cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 17:05:52.371626 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.wsgi [None req-dd5e67dc-9db9-45f6-8db0-1a7b64ad7b47 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] HTTP exception thrown: Instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 could not be found. May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-dd5e67dc-9db9-45f6-8db0-1a7b64ad7b47 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Request method failure captured: May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: request: GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 HTTP/1.1 May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept: application/json May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Accept-Encoding: identity May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Connection: close May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Length: 0 May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Content-Type: application/json May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Host: 10.222.0.48 May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Openstack-System-Scope: None May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: User-Agent: python-urllib3/1.26.9 May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Auth-Token: gAAAAABij7Lq1iHH8FDCrhc11r9YN2p3RfCgXlPwDN5pCe004rxjkdmGPyBS_FFjLRusVJgLRyv7-n1fDJY1OqvGnHhe69FTOLZ6cL_XUHA0KWZRo32ytxTAYnvwZFb_HkQjQs4tq3UwJeeAXsGgoawsMomvPi25DjwK4AdBys6Cl6Tfw6k7RAI May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Id: None May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Domain-Name: None May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Identity-Status: Confirmed May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Is-Admin-Project: True May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Id: default May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Domain-Name: Default May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Id: 0087e93bc2524a29b22a4adedec49ea6 May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Project-Name: tempest-TestMinimumBasicScenario-1457916280 May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Role: member,reader May 26 17:05:52.373335 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Roles: member,reader May 26 17:05:52.375967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0087e93bc2524a29b22a4adedec49ea6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/0087e93bc2524a29b22a4adedec49ea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_0087e93bc2524a29b22a4adedec49ea6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/0087e93bc2524a29b22a4adedec49ea6"}]}] May 26 17:05:52.375967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant: tempest-TestMinimumBasicScenario-1457916280 May 26 17:05:52.375967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Id: 0087e93bc2524a29b22a4adedec49ea6 May 26 17:05:52.375967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1457916280 May 26 17:05:52.375967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User: tempest-TestMinimumBasicScenario-1457916280-project May 26 17:05:52.375967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Id: default May 26 17:05:52.375967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Domain-Name: Default May 26 17:05:52.375967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Id: d4864aa668bd4b3ba45d9570d94d4601 May 26 17:05:52.375967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: X-User-Name: tempest-TestMinimumBasicScenario-1457916280-project May 26 17:05:52.375967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: method: > May 26 17:05:52.375967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: exception: Instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 could not be found. May 26 17:05:52.375967 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: action_args: {'id': 'e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6'} May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: {{(pid=124837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 could not be found. May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 17:05:52.376968 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 could not be found. May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 could not be found. May 26 17:05:52.378719 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: ERROR nova.api.openstack.wsgi May 26 17:05:52.380203 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: DEBUG nova.api.openstack.wsgi [None req-dd5e67dc-9db9-45f6-8db0-1a7b64ad7b47 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Returning 404 to user: Instance e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 could not be found. {{(pid=124837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 17:05:52.380203 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO nova.api.openstack.requestlog [None req-dd5e67dc-9db9-45f6-8db0-1a7b64ad7b47 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6" status: 404 len: 111 microversion: 2.1 time: 0.034464 May 26 17:05:52.380203 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: [pid: 124837|app: 0|req: 629/1263] 10.222.0.48 () {58 vars in 1235 bytes} [Thu May 26 17:05:52 2022] GET /compute/v2.1/servers/e1b7782c-a3f8-4fcd-8c2c-06fdc7b86ed6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 17:05:52.384696 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: DEBUG nova.api.openstack.wsgi [None req-1722341c-c31d-40bd-bc03-fff3941fbd55 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] Calling method '.version_select at 0x7fbe806449d0>' {{(pid=124836) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 17:05:52.477916 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO nova.api.openstack.requestlog [None req-1722341c-c31d-40bd-bc03-fff3941fbd55 tempest-TestMinimumBasicScenario-1457916280 tempest-TestMinimumBasicScenario-1457916280-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1292168754" status: 202 len: 0 microversion: 2.1 time: 0.097126 May 26 17:05:52.478505 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: [pid: 124836|app: 0|req: 635/1264] 10.222.0.48 () {58 vars in 1271 bytes} [Thu May 26 17:05:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1292168754 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 17:06:51.290502 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:06:51.291241 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Thu May 26 17:06:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:06:55.016003 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:06:55.016678 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Thu May 26 17:06:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:08:20.421774 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:08:20.422509 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Thu May 26 17:08:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:08:33.316004 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:08:33.316596 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Thu May 26 17:08:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:08:37.250553 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:08:37.251212 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Thu May 26 17:08:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:08:59.951250 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:08:59.952064 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Thu May 26 17:08:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:10:11.300896 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:10:11.301567 dv-cinder-836070-4-iscsi devstack@n-api.service[124836]: Thu May 26 17:10:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 17:10:15.026829 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 17:10:15.027479 dv-cinder-836070-4-iscsi devstack@n-api.service[124837]: Thu May 26 17:10:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!